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.Koran, John^J., Jr.,. and Mary Lou Koran. ' "Differential 'Response to 

St^uct^re of Advance Jrganizets^n Science Instruction." Journal 
of Research in Science Teaching , 10(4) :347-353, 1973. 

Descriptors—Academic Aptitude, ^Cognitive Processes, ^Conceptual 
Schemes, Educational Research, ^Elementary School Science, 
*Leaming Xhebries, ^Programed Materials, Science Education, 
*Student Reaction % 

Expanded AbstHact and Analysis/ Prepared Especially for I.S.E. by Glen S. 
Alkenhead, University of S^katchewan. 



j^urpose 

The purpose of Koran a^d Koran's study was to investigate individual 
differences in learning when the instructional materials have been pre- 
ceded l^three kinds of introductory passages: (1) higher level 
gerleranzations with specific examples (an advarice organizer), C2) 
higher level generalizations without ejpmples (an advance organizer), ^ 
and (3) a control passage. 

It was anticipated that the greater the degree of 
structure provided by the advance organizer, the more likely 
it would be to reduce the burden of semantic processing, and 
thus benefit those learners with less ability to develop an 
adequate conceptual scheme of their own for organizing new 
material. Consequently, in providing differing amounts* of 
structure, performance ... was expected- to be dif ferefitially 
related f:o IQ ^scores, (p. 349) 

Rationale . ' * 

^* • 

Ausubel's learning theory predicts that "meaningful learning" 
.(higher-order learning characterized by Bloom's hierarchi1:al scheme) is' 
.enhanced by providing students ahead of time with, an "advance organizer" 
(a sequenced piece of instructignal material that is more general and 
more abstract than the ideas it precedes). The function of an adv-ance 
organizer ijs ^to afcfivat^ relevant concepts (called "subsuming concepts") 
which students have already learned and which forrii part of their. own 
cognitiva strvcture. Subsuming- concepts are considered relevant if they . 
can be useful in leaSming the ensuing in/ormation. Thus, an ^advance 
organizer sly>uld facilitate learning. 

^ f' 

It follows then that advance organizers will, -first of all, differ » 
depending upon the content they pre-cede (for example, familiar versus, 
unfamiliar content); They wiit also diffqr. depending upon the' character- 
•istics of the students interacting with the advanc^ "organizers. 

The study by Koran and Koran is related to many Investigation^ ; 
those concerned with the effect of advance organizers, and those concerned 
with the interaction between different student characteriatics and varying 
modes of instruction.' The authprs drew' upon numerous empirical findings 
that suggeat different sjfudenta learn' more,^ and with greater ease, with 



•/ . * 

different kinSs of instructional me\*^s'. While Kotan an^U^ accept 
the assrumptions inherent i^ Ausubel's theory, ther^ appears to be an 
important incongruity between the authors' and Au^^bel's ideas concerning 
the function of an advance organizer. A discussion of this appai^nt 
T-difference of opinion appears at the end of the section "Abstractor's 
^alysig." 



Research Design and Pro cedure 
'. 

Design: Students were randomly assigned to three treatment groups, 
The same ^achievement test was written on three occasions; pretest", 
immediate' posttest, and delayed posttest (one week delay): 

/^T -0 -T ^ 

A 2 A 
T -0 -T 

B 3 B 
T -0 , 
C- 4, Cj 



Treatment : The Same programming ^ibooklets concerning insects (30 
specific concepts dealing with insects) were st^idied by all three groups, 
However, the introductory passages differed for each group as follows: 



Group A: 



.a passage (advance or-ganizer) describing the study 
of insects in* terms of higher level i^eneralizations 
along with specific examples using animals familiar 
to students. 



Group B: a passage (Hlvance organizer) describing the study 
of insects in terms of higher level, generalizations 
without specific examples. 



1 

Group C: a conjjirol passage containing historical information 
neither generalizations nor examples.* 



wil 



All students ufere given sufficient time to finish their. work, 
duration of tie study was not reported. 



The 



Variables ^ Students' khowledge of the material on insects was 
assessed by: *(1) a 30-item multiple-choice test (Oi, O5, Og) which had 
an internal consistency reliability of .78. Each item presented a name 
of a concept for which a correct example had to be chosen from three 
alternatives,' and, (2) t\ie number of errors made during the study of the 
programmed material (O2, O3, 0^), called "program errors." 

In this. study, individual differences were defined in terms of, 
student abilities, measured by IQ scores (Otis-Lennon Mental Abilities 
Test). ^ ' ' 

Sample : The sample consisted of 89 fourth-grade students enrolled 
in an upper middle class Houston, Texas, scheol district which was 
familiar to the investigators. 
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Analysis : . ' ^ * . 

(1) "A 3 (treatments) x 3 (triads) repeated measures analysis 
of variance was used to test instructional treatment main 
effects for criterion test scores ...'The assumption of , ' 
homogeneity of regtessibn underlying the use of the 
repeated measures model. was tested and accepted." ' 

► ^ -(p. 349) The triads w^i^ the pretest, immediate post- 
test and the delayed posttest. 

(2) A one-way ANQVA used program errors made during the 
progralmned instruction, to detect differences among the 
three treatment groups, - 

(3) A simple linear regression "related IQ scores and 
criterion var'iables '<program terrors , inanediate posttest, 
and delayed^ post test). "Aptitude x Treatment inter- 
actions were evaluated by comparing regression slopes 
obtained for each aptitude criterion pair in different 
treatments using F te'sts for heterogeneity of regression." 
(P^ 351) , ^ 

\* Findings ; ' ' 

(1) 3x3 ANOVA: "A significant treatment effect was foimd 
across trials, from pretest to posttests. however, be- 
tween^group differences did not ^attain significance." 
(p. 349) 

(2) One-way ANOVA: No significant differences among the 
treatment gfoups were found. "Thus, from the average 

data alone, the three treatments were about equally ^ 
effective iA terms of promoting retention and errors,, 
during' instruction." (p. 350) 



*(3) Simple linear regression (aptitude x treatment inter- 
actions): IQ scores failed to interact with instructional 
treatment for either invnediate or delayed posttest scores , 
but did produce a significant disordinal ^ntetaction with 
,the fnstructionfel treatments for program errors'. IQ 
scores were negatively related to program errors for 
groups B and C (those receiving generalizations alone ^ 
•or a control passage) while positively related to 
< program errors for group A (those receiving generali-^ 
zations and examples). 



Interpretations ^ 

The thre^ instructional treatments were about equally effective 
when assessed by program errors and posttest scores (immediate and 
delayed). This concurs with previous researcji, which isj cit^d in the 
article. Koran and Kocan thought that the null results might be 
explained 6y experimental conditions such as the unexpected familiarity 
of the content on insects and the generally high ability level of the 



sample. Also a rehearsal effect of th^ pretjBst on^posttest scores could 
have coacei\^bly reduced pos,sable differences in postt^gt scores. However 



The significant aptitude X treatment interaction between 
IQ scores and program errors tends to support the hypothesis 
that during instruction low ability subjects were more reliant 
on the organizing features of the program, whereas higher^ 
ability subjects were more effectively able to organize 
material in the absence of highly structured advance organi- 
zers. Thife finding appears to support a growing number of 
indications t"hat\in some cases highly structured treatment; 
may actually be dysfunctional for high-ability subjects. ^ 
(p. 352) . , 

. Such an interaction effect was not observed for-'the two postCest 
scores. The investigators suggested th^t the nature of the programmed 
materials themselves and the generally high ability level of the sample 
might possibly explain the null results. ' (High IQ scoring students -may 
impose their own structure on the materials regardless of any type of 
advance organizer.) 

Koran, and Koran, in recognizing their very limited positive findings, 
mention that the learner's condept organizing operations may require ^ 
"sharper definition" than is. presently found in Ausubel's theory, 4)ef ore 
further research can be productive. The authors dlso recognize the need 
for greater clarity in aptitude measureis, instructional procedures, and 
criterion me^tires. « • * 

' ABSTRACTOR'S ANALYSIS * ^ 

« 

Criticism of science education research studies usually- focuses on 
three inain issues [Hurd.(2), Kempa (4), and Shulman and Tamir (7)]: 

(1) lack of a . theoretical framework or the lack of an extensive 
research base., / \ 

(2) methodological flaws in the design and implementation of the 
investigation, and 

(3) lack of attentibn to problems in learning. scientific know- 
ledge in general, and specifically, lack of atterition to 
individual characteristics of the student. 

None of these points can apply to the study by Koran and Kor3n. In fact, 
their investigation exemplifies the type of research which critici 
usually describe as a paradigm to follow. ^ 

Koran and Koran's study logically 'progresses from past research 
studies. In particular, it relates two areas of great interest and 
concern: (1) the interdiction of different modes of instructieil with 
diffjerent characteristics of students, often labelled ''aptitude-treatment 
interaction," and (2) Ausubel's construct "advance organizer" which has 
been one of the most researched aspects of his theory of learning. This' 
study by Koran and Koran cle^irly demons'trates how researcl) can take place 
In a context of established theory and empirical 'findings.- 



The reader who is new iLq__science education research reports will > 
benefit from noticing a number of other excellent qualitiefe exemplified 
in Koran and Koran's -report. The article is clear, concise,, and precise. 
The authors remind the reader of the es^endial aspects of Ausubel's 
theory whicli fere gepnane fco their study. References are included for 
tliose readers who would»like to acquaint themselves with Ausubel's theory 
or with aptitude-treatment interaction. Jargeo is used only for precision 
and not for academic impact, (Some researchers fend to overuse erudite 
phrases steeped in jargon. However, others attain a clarity of expres- 
sion with everyday Anglo-Saxor^ words and expressions.) , 

I would like to draw the .reader's attention to the research ''desigA 
en5)loyed in this study. Its randomization of students to treatmer^t 
.groups provides a powerful technique ^for making valid inferences*. The 
repeated measures analysis of variance is very appropriate and its 
assumption of homogeneity of regression is discussed. (A writer is well 
advised to report the major assumptions underlying the statistics he 
uses and to express the conformity of his data or design to these ^ 
^ assiWptions.) • , 

The comparison of regression slopes using F bests for heterogeneity 
9f regression is a* sophisticated, technique for detecting interactions. 
It has adv^tages over the more familiar two-way ANOVA. One of these 
advantages is using continuous data rather *thm arbitrarily » defined 
discrete groupings of data necessary in most two-way ANOVAs. However, 
had Koran and Koran included a graph of these regressions, I think it 
would -Jiave clarified their results reported in ^abu^ar form. 

Th e inv estigators yse a^freatment which is very easy fo^c anyone to 
replfcate because it is cieatly defiaed and is in a written form. In 
Vrontrast, some research re^ports are terribly vague aboat ^he treatment 
(for example, "CHEM Study" arid "Traditional"). Jn addition, -Koran afid 
Koran minimize spurious tiri^atment effects, such as tie effect of ^Ittir- 
ent classroom teachefs. / ' 

The authors are careful not to overgeneralize thfeir findings. 
Their results are treated in 'the proper context: That the advance 
organizers preceded carefully sequenced programed materials. It is 
left to further research to resolve what would happen when advance ^ 
organizers are used with other types of 'science materials or presen- 
tations.^ * . ^ ' ' ) " 



the 



Let me noy^tum my attention to soitseH*6ues which are more related 
to the current state of research in the area of instruction. In par- 
ticular, I shall examine three toffies with respect to directions for 
further res^arcih: student c-haracteristics*, meaningful learning, and 
advance organizers. * ^ 

Studentf Charactrerlstlcs : It is certainly an understatment to s^ay 
that the process of Instruction and learning is a complex one. The 
interactive fact firs that affect student achievement include: Cl^sroom 



r 



Becatise of the- care with which the autliors designed the itudy, 
carried it out, and analyzed, the results, one can feel conlident in 
validity of their results. ^ ' 

' * • m 



ERIC 



7II 



environment, teacher characteristics, hoiae ^epvitqnment (fof exampley 
parental interest and expectations) , Vand/st-udeht [characteristics . Stu- 
dent characteristics themselves ♦.encompass plethora of categories;'- 
f or ^xampleV interests,, abilities, , ^ ^tit|-ddes> ,nee^s, aptitudes, motiva- 
tion. This list of interactive foTTces iig^ ,ftajr fT?^m Complete. I However,, 
in- its shortened form it still point^s out !that the me.asurement of ot^ 
•or tvTo student characteristics (sex, IQ scores, divef'gent and conv^rgeht 
thinking, analyt^ic and global^ or intuitive problem .solving,^ Sigel^ s i 
cognitive styles, background knowledge of the specific toyr, artd read- 
ing skills, to name but a few) does npt hold much ptomi&eMn accounting 
for a significant amount of the variance 'in student achfeSremerit . This 
view is supported by the high instances pf null findings .reported in ^ 
the literature, the present study included. » [See fpr example, Herron 
et al , , (1).] 'Not only does the definition and measurement of student 
characterist'ics require a great deal moj^ st^dy^J)JUt_^Q. .does' its rela- 
tive influence compared with other interactive factors. For instance, 
if it were established that? parental expectation accounts for more 
variance in student ^achievement 'than does stud^t ^l^aiftiing styies, then 
the^ imp^lications for the improvement of instruction would be much 
different than ^f student styles were found to be %ore influential. 



Meaningful Learning : Ausubei^distingui^es between rote learning ' 
and meaningful learning^^by alluding to Bloom's taxonomy. Meaningful 
learning is considered to b« higher-order learning in Blooms hierarchi- - 
cal' scheme (for example, solving novel but relevant problems). Auaiibel " 
assumes that advance, organizers will only facilitate higher-drder 
learning. , Therefore, achievement tests, which a re^ meant to distinguish • 
between control groups and groups having advance organizers mast assess . 
riigher-oKder learning. A study such as Koran and Koran's should ensure 
that the achievement tests m^el^ this expectation and that lower-order 
learning, such as recognition, iS^not a major component o£i a test. 
Perhaps Koran and Koran did so., but itT.s not reported. Kahle and 
Rastovac (3) have publisl>ed a procedure wh'ich helpen thera ensure that > 
a full range of questions were us^d on achievement tests. (The^r. too, 
investigated the effect of. advance organizers.)" Nul^l findings axe 
almost inevitable if criterion measures are not well represented by 
questions assessing higher-order learning. . ' ' ^ , • * * 

Advance Organizers ; The concept of advance organizers is perhaps 
one of the most confused aspects of Ausubel's theory. Novajc (5) has 
attempted to cl^tify this confusion. In order to emplfaslze the role 
played by the individual's 'previous knowledge (his cognitive structure 
with its network of subsuming concepts), Novak renamed advance organizers, 
He called them "cognitive bridges. A cognitive ri>^ridge links certain 
subsuming concepts to the material to be learned^. "Cogntiti^e 1)ri*dges 
are shdct segments of learning material that prgvide guidance to the 
student as^ to which 



concepts in cognitive structur^^might best be 
eani{igfully." (Novak 5;,500) ' / ' 



employed to learn mean 

s • However, by using Novak's clarification, I see som^ major problems 
for researchers. If ♦Kv'an and Koran w^re to follow Novak's de.finition, 

, they would have had %o discover, the relevant .subsuming concepts 
possessed by their sample bf students. ptl;ierwise, one could not , 
exppct the advance organizer to have* a significant effect ou posttest 
scores. Given today'^ technology, it seems to be^ unreasonably difficult 

'to link advance organizers with individual students' subsuming concepts. 
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KO/Tan .and Koran.^s notion of -advance organizers appears to be quite 
(different from Novak's. To Koran and Koran, "the fuiiction o^f the advance- 
' organiser is to provide struc.tuie of ' iideational scaffolding' (a (Juota- 
» tion f rom Ausubel) for. the incorporation' and . retention of material ... 
•r and to increase 'its dispriminabi.lity,.^' (p. 348) Therefore, Koran and ^' 
•'.Koran believe that advance prganizers can differ. with respect to^ their 
,v degree of structure.. They argue that the mare ^ructure inherent in 

an advance Q^ganizer,^ the less the student need take responsibility for 
' ^organizing thfe material in his oyn way. ^ This notion ol advance organ-^ ' 
izers related more to the act of information pro^ejesing than to Novak's 
link between specific subsuming concepts ^ready in the student's cog- 
nitive structure and concepts 'to be learned.^ To Koran ^d Koran, th 
learner constructs his 'own- relevant subsuming concepts, guided by the 
. structure offered .b^ an advance organizer. • ' 
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Because of some general famil:^arity with' the content and 
the higji* ability level of the sample-, many siib'jfects would be 
expected to already possess relevant subsuming conde^ts to 
, some extent, thus reducing the potential learning advantage ^ 
' ' , of the adyance x)rganizers. (p: 350) 

On the other hand, NoVak seems to be saying that^the relevant ^ubsuming 
• concepts are already constructed in- the learner's cognitive structure, 
^ and they only need to.be cued into act:^,on by the advance cy^anizer. 
The reader is presented"~v^i<^ two distinct incongruous views UaJortu-^ 
nately^ these differences cannot clarified by Ausubel's original ' 
work.' 'Jhere/ore,, before further research can be Very illuminating,^ 
.investigators must form a <;:pncer\sus concerning th^^unction of advancje' 
organizers. Ko fan -and Ko^r'hn^-came to a similar coi^lusion: "As jCron-' ^ 
bach and Snow' have suggested y »the yhole concept of organizing operations 
BV the learner may require st^per defirii^tion before ^theorizing aad^ 
research can proceed f ruitfi»lly.^' (p, 352) ' 

There could be anotheii. problem. If advance organizers do not work 
effectively when students possess the relevant subsuming concepts, and 
if students visually do possess -the relevant subsuming concepts to some' 
jlegree Koran and Koran's 5tudy suggests), then the effectiveness of 
ast advance organizer in norm^ classroom situations would seem to be 
.minimal. Consequently, on^ might uaot eitpect useful results to emerge* 
from research into the effectiveness of advance organizers. ^ 
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Nolis, Albert and Ronald Raven. ?'The Effects of a Structured Learning 
Sequence on Children's Correlative Thinking about Biological 
Pfienomena." Journal of Research in Science Teaching^, 10(3) :251- 
.255, 197%. ] ; ^ ^ 

Descriptors — ^Academic Achievement, '"^Biology, Cognitive 
Processes, *Instructionlal Materials, Intermediate Grades, 
. *Learning Theories, Science Education, Secondary Grades, 
• *Thought Processes . 

Expanded Abstract and Analysis^ Prepared Especially for I^S.E. by 
William R. Brown, Old Dominion University, Norfolk, Virginia. 



Purpose . ' 

The^purpose of this investigation was to •determine if cortelative 
thinking in fifth, seventh, and ninth grade children could be faqili- 
tstfed by a Piaget-based structured learning sequence. If Subjefcts^ who 
have, acquired formal operations, are presented with the operations of 
logical multiplication, class inclusion, equivalence, and reciprocal 
exclusion, then th^y should be aiple to sblve correlation tasks. 

Rationale 

^ ' V . < 

The findings of Inhelder and Pilget suggest that the aequisit'ionf . 
of cofrelation operations is dependent upon the development of the 
following operations.: logical multiplication, class inclusion, equiva- 
lence,- and' recipVocal exclusion. A sjtuiy by Smedslund concerning they^ 
concept of ^correlatibn W adults along with the work of Inhelder and 
Piaget suggest tJiat the«us^ of a training program whose design imple- 
mented these Ibgical structures would enhance the acquisition of the 
correlation Operations. Biglogical principles such as structure and 
function, predator and prey% camouflage aijt^^redetion, and mimicry and 
survival are examples of correlative-based^ rules found in elementary 
school and junior high school science p^rograms. 



Research Design aitd Procedure * . 

The independent variable was a set of structured training exerc-ises 
in fou/ parts. (IJ 'The logical multiplication exercises required the 
students to construct four sets of object combinations, from 2x2 tables. 
(2) The ^ass inclusion operations involved the construction • of the * 
marginal ' elements in the 2x2» tables that had completed cells. • (3) The 
equivalence and teciprocal exclusion operations used, tasks who^e solu- 
tions demanded the construction^pY binary relationships of the diagonal 
cells. (A)* The correlation tasks used problem^in which, the equivalence^, 
and reciprocal exclusion cases were summed and compared to determine the 
event diagonals of greatest frequency. This enabled students to state 
the rule. . ^ 



The- three-hour training program used a deductive-generalization mode 
of Instruction. The program and test were used, in two pilot studies. 

^ . ^ ' • ( 
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Th« dependent variable was achievement on.>t:arrelationaJ thinking 
tasks. A rationale was presented for a treatmeht-poyttest only design 
( X o). ^ ^. ^ , / . . 

..i.'Q?A.P°sttest consisted of six correlation problems. Each of the 
problems was presented in 4xS c^ll' pictorial format. KR-20 coefficients 
range'd from .80 to .86. ' ' « * 4^ 

The subjects wer^. 119 fifth grade; 90 seventh grade, an* 156 ninth 
grade students from three parochial ' sphools. The sample^ were all the- 
students at these grade levels. * 

- ^ . , ^ 

All students received the sa'ike traiuin^ and testing sequenc^--' The 
relative efficiency of the training program was determined by comparing 
the achievement^ of fifth graders 1^'on^^rete operations level), seventh 
graders ^transition levtel), and ninth grades (formal operations level). 
Multivariate analysis of variance was used indicate significant 
difference ^n achievement among the graces. \ ^ ■ 

Findings " - ' ^ . ^ ' 

An F of 4.21, p <.001, indicates a significant difference in 
achievement among the grades. - , yf 

An analysis of the mastery of the- correlation problem in th6 training 
sequence showed the following percentages of achievement: Grade 5-30 
percent. Grade 7 - 29 percent, and Grade 9-48 percent. All of the 
groups had difficulty in ^hose tasks that exhibited no correlation. < 
Ninth grade students were^'relatively Successful in forming rules, but 
less successful in forming operations on tb-^ pair combinations using " 
equivalence^, and reciprocal exclusiSns. ' , 
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Interpretations . * 

The results, of this study sufcport those of Smedslund and tho^e of 
Inhelder and Piaget. Most students ^ , the early formal operations stage 
are not able to use correlation operations to construct rules from 
data.* Students in the early formal operations stage did benefit from 
the training. The biological principles *involving correlative-based ^ 
rules should be presented to youngi ch:^dren in such a. manner that corre- 
lative operations are not required. 



ABSTRACTOR'S ANALYSIS 



Beard refers to "relations* between relations" as one* aspect of ^ 
formal operaticJnl (l:125rl33). Several studies are cited dealing with 
the operatiortf which are\part of this study. Beard states that "many 
adlilts do not attain the'lev^l of formal operations except in some 
limited areas; if they are- neither well ^edugated nor of good intelligence 
they may hardly reach it at all." "The prpt)]^m for the teacher is to 
use teaching methods in such' a wdy as toj maximize development of formal 
thinking whenever it is possible." 



Beard's comments have several implications in connection with this • 
study. First of all, ev^n though the inve^stigations reported the mean 
age of the students p«r /grade level, it was assumed that grade level was 
an accurate descriptor of Piagetian level of development. Were all ninth 
grade s,tudents at the formal operations level, specif ic,ally for the- 
relations betweefi relations set of variables? Perhaps'^ assessment of 
fetage of development should have been considered prior to inclusion of 
all students' in , the population sample. 

A second factor to be' considered is the yalidity of the criterion 
test and the training program. / No validity indices are reported. 

A 'third issue is the time sequence of the study/ The criterion 
tests were adainistered the day after the students completed the train- 
ing program. It Would ^be interesting to assess the long-term effects 
ofc- the training program. Doe$ the program produce long-term i:esults 
with wide applications to numerouff^ correlative problems? • 

\ If concept develdpmeht is considered* as a developmental phenomena • 
^dependent on both Piagetian stages of development and experiences, rt^en 
several implications can be suggested. Froia a research viewpoint, task, 
analysis type dissections of curricula should be conducted in order to 
assess what types of ;nental operations are necessary in order to success- 
fuj.1^ handle Jjjfecific bits of the curriculum. This^"need" is also 
ifidicated as a top pr^.ority for rese^ch in science education by NARST 
members (2:163). j The instructional bits could then be arranged in a 
sequential order: ^that v^ould complemervt^Jteyels of cognitive development. 
Teachers and admi^tiistrators at all levels must be encouraged to become 
involved ai)d stay involved in 'this* type of fundamental .research. 

From a curriculum aiid instruction viewpoint, educators might 
approach curriculum decision-making from a goal-oriented attack rather 
than from a subject matter orientation. For example, a curriculum 
decision might be ta develop correlative thinking In adolescents. The . 
•selection of instructional strategies anrf materials would be based on 
^his stated goal and the^ implications of research rather than on tH^ 
selection off topics f rom , specif ic disci^^inear such as science. Impli- 
cations from the Nous and Raven study ^indicate that certain adolescents 
can benefit from instructional strategies that develop correlative 
tjiinking. Topics such ^s the complementarity of structure and function 
i^i^t be included for older adolescents.* The' placement of this topic 
would be based on appropriateness in attaining the curriculum goal of 
developing co^-relative thinking. I'^umerous activities sbbul^ be provided 
for youngsters to develop, correlative thinking such as the use of a two. 
dimensional matrix board where numerous at,tributes may placed and 
interrelated (3:224-225). ^ 

Helatioris between relations Js a critical factor in a comprehensive 
understandiag of science as field of inquiry. The development of 
appropriate teaching strategies, the selection of content; and the 
assessment of bot'h these factors imist be encouraged. 

/ 
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.Raven, Ronall^and Herbert Strub;Lng. . "Infra'f actor. Transfer In s/cond 
Grade ftiildren/' Sjclence Education , 55(1): 31-38, 19 71* 
De8criptors-*-*Achievement, ^Elementary School Science,* 
♦Instruction, Learnings Thysical Science^, Scientific Concepts, 
. *TraA^fer of Training, Visual Perceptiorf . " 

Expanded Abstract and Analysis Prepared Cspeodally tor I.^.E. by ^Je'rry / 
G. Horn, Th 87 University of South Dakpta/ ^ , ^ ' 



Purpose 



f # 



The general purppse of this study Is to^ jc^etenTmifte if second, grade ; 
children's learning f^rotn t?he' Science Curriculum Improvement -Study ' ^ 
unit Relativifcy (sic), of fositiWanci Motidh can be a^gnif icantly 
imp.roved -by prior training vitii one* of -two units sele^cted from th^ 
Frostig Program for'the Development of VLsTjal Perception. . «y ^ 

* ' ' ' -P^ ' ^ 

Rationale \ , ^ ' * <^ 

There has been an increasing interest ,i,n '^he use of intrafacty 
^transfer in classroom ^J^^saming. Mo6^ educatofs haye di^scar'ded the view- ^ 
point that lemming is very specific and .ik limited 'to^ the kin<j of task 
that is exercised. Contrary to a position taken by Thorr><tik^/ Guilford 
suggests that tHere' is growing evid^qce of intrafactox tranisfir whicfi • 
shows, that leiimlng need not be nanfow or (;x>mpletely specific. «• 

" ' . ' ' ^ \ • * ' -'^ . > . 

Certain science curriculum projepts, "suoh as A.A.A.S.' Sdiencer-A 
Prtfcess Approach , *'are designed on the pt;eflrise t^hait ^transfer of training ' 
can take place ift .the ''context of th^ xlaisrpom environment; • This* post- ' 
t-ion .is supported by the work of Gagne -and" Pay^di^e. ^d ijpder^bn. ^ - 

One of the assumptions upon wbichr the' Strategy of cufri-culum develop 
ment rests Is that there will >^ transfe^^bf knowledge .and skills within 
and among learning sequences.' The purpose of the SCK- iinit Relativity 
(sic) of Position and Motion is to develop frSmes of rcfefeace or 
describing the position of a system.; 'Piage-t's studies, of operational* 
coordination suggest that the ra^jqtity t)f (second; grade /students would 
have di^fjtculty achieving -oq the'science relativity ,iJbit. \' 

Qronbach has dif f ^rentiatea between "substantive transfer" ,arid ' . 
**apti^udinal transferir," irv that "subsjtantive transfer refers to common y 
•^elements an^ aptitudinal transf e*r ^refers to the prep^reation to learn 
f roin an environment *,that may h^Ve no substance in common wifh that which 



l^jgaear^ D^sifen gind Procedure ^ ' \ ^ 

The sample siAjects utilized in this ^tutly comprised the students 
or all nine second-grade classes in all of* the public schools in the 
•olty of Dunkirk, S^w York, fhe subjects \^ere heterogenous with regard 
'to race, natloniiity ,and socioecohepnic group. The mean, chronological 



age was ..eight years and two ponths, and the mean IQ, (Kuhlmann-Ande^rson, 
7th edition) was 106.5. ^ • * v . - 

' ♦ ' ^ * * . 

Each class was divided into three randpmly assigired experimental * " 
groups; The first treatment for each of the three groups* is found 
belcw; ' - . / ' . 

- ' ... , ♦ ^ I • 

' ^ \ Group I: Frostig Spatial Relationsh^.p iinit ' . 
\ ^ Group II: Frostig Visual4lotor Caordinatlon unit 
N Group III (control):' "Outlined pictures to color" 

The treatments were provided for fifteen days. The teachers of stjie 
subjec'ts monitored the activities and restructured the xoom arratigment 
to pre^t contamipati^oti of the learning situations In the vario(is 
groups. A second ti?e>^tment, the science relativity lihit, was undertaken 
1)y'all groups (I-III) for twelve days. Xh^ teachers were given a ^et o'f 
►lesson plans^ that described> what was'to be- covered, how it was fo be 
covered, and how much time was to be allowed for each activity^. 

All studejits^were administered the science relativity unit achievement 
test three days ^f ter» the completion of the instruction cfh the science 
relati*vity unit. A pilot study^was undertaken'^Tor the purpose of estab- » 
lishing the reliability for the test, and it was determined to be O.'SO 
(Kuder-Richard§^F6nnula #2^). The Metropolitan Achievement Test scores 
and^the Kuhlmann-rAnderson Intelligence test scores were also obtained for 
each, pupil from the schools' records. ^ ' 

The basic experimental design is diagrammed below: • 
-I 
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The smallest number of subjects in any one group was. seven. Th^ 
' computer program for the statistical test, used in tbis stildy demanded an' 
orthogonal design which requires that the number of observation's in each 
possible combinatiort- of treatments is the satae. The size of the com-» 
parison groups was equalized at seven by* random procedures. This resulted 
in a total sample of 189 subjects (three groups x nine classes x seven 
subje^cts « 189). A Cwp-\^ay analysis of variance (mixed rffects model) 
for treatment and c^lass was performed. ' Althougty^ubjects were assigned 
to treatment groups by random procedures, IQ axuA achievement te3t scores 
were coinpared to determine if a systematic bias did exist. 




.Findings ^ , ' ' 

\ , 
Based on the analyses of the data, St\«s found that the two 
'treatment gtoups (Frostig Spduial Relationship group and Frostig Visual 
Motor Coordination group) did significantly better (at the .01 level) 
thap the control group ("outlined pictures to color"). No difference 
w^d found between the two experimental groups (I and II). ' These results 
•how that a proactive facilitation. occurred between the Frostig units 
and the science unit. . ' ] 

"•• • " 1620 ^ . ; ' . 



' Interpretations ^ ' ' , " " ' 

, • ISubstantive tr»tasfer of the specific content taUghM>y the .Frostig 
Perception of Spatial Relationships unit ejihanced learning on -the science 
unit. Aptitudinal transfer' of the general conteTit taught by the Visual- 
Motor unit also .enhanced learning, on "the science unit. One of the 

^' reasons for fhis may that there are some skills that are, treated in 
the Motor .Coordinatidn Lmit which are distantly related to the science 
unit. * . ■ - 

There were significant differences (.05) f ouhd ,betVeen the classes, 
-but the aluthors administered the science achievement test to minimize 
cl^ss differences. The results Qf this study must;be tempered to somey 
extent by th# fact that the mean IQ 'and Metropolitan Achievement Test 
scores of ^th^e control 'group were slightly less than the corresponding^ 
-scores of the experimental groups. » ^ , , ' * 

* . • ' • 

The results of this study seem to indidate that the type of ^ r y 

perc^ptiaal training provided may not^be the m'dst'^significant factor in 
achieving on the, relativit/ science unit. Perhaps, the most important 
aspect of prior perceptual training is ;Lts ability to bring 'into focus 
for^the chilci the elements of perception in general. 

V 

* ' ABSTRACTOR'S AI3ALYSIS 

The /eContent and nature of this study obviously* address concerns 
basia tp the total education -process, such as the' potential fof the 
transfer o'f learning and the lack of necessity for narrow and specific 
leaifning tasks. Also, as a secondary' purpose*, it helps to establish 
validity for a specif ic program said to develop visual .perception. The 
authors of this' research -xeport utilize the SCIS materials as a part of * 
the project, which probably attracts a particular audience of readers ' 
that may not normally seek out studies on learning and intellectual 
development.' v ' ^ • ^* 

The review Qf t^ie literatupre was found to be central to the study, 
and' a reader wo.uid have difficulty in understanding the results and 
implications of this research^ unless it had beer> thoipughly conce^=-\ 
tuJlized. Jhis abstra'ctor 'had some jirLnor concerns about the title of 
the SCIS unit as listed in the report,^ "Relativity of Position and 
Motion." The current SCK unit, of this nature is "Relative Position 
and Motion, " and one, might presume this to be a preliminary version, 
although no mention is jnade of this specific title even as early as 
1968 in ^he stlS Elementary Science Sourcebook . This problem seems 
very tangential to this study -iid warrants no further ^commeats. 

Since Campbell and Stanley's works are often used .in developing 
research '^lesigns, the references made to this material by the authors' ^ 
1^ commendabld. The papej: itself was written in a format ^hat is .easy 
to follgw and, is free f rom' uprela^ed in^f onaation. ^ ' 

The random issignment of students vi-thin a class to one of the 
.three .treatment groups should be highly regarded. A more usual practice 



is the assignment of a class to one treatment, thus in this case there ' 
would be a total sample size of nine/ and a cell^ size of three for each 
treatment group. * ^ • . 

In reviewing the data which were in the original article but not In 
this abstsract, one cannot help but note that the control group hAd the 
, lowest mean score o* all three groups on the measures of IQ and achieve- 
ment. The authors set this aside by quoting Campbell and Stanley on 
.randomization as an "acceptable guarantee against one group having more 
or less ability than another group." One wonders if the deterndnatiorv 
of the correlation of age, IQ and general achievement with the dependent 
variable in this study (''science ach^Levement") migbt not provide some 
useful insights. Otherwise, the research design and scatistical treat- 
ment of the data are appropriate within the limitations imposed by the 
nature of the sample. 

In the description of the subjet:ts it was stated, "the students 
represented all races, nationalities, and socioeconomic groups commonly 
caXled 'culturally deprived'." One must find great difficulty in the 
interpretation of this statement, particularly when attempting to 
generalize to another locality.' Does this statement mean that all races 
are in the cityN^f Dunkirk, New York, or does it mean that all racefe 
that are commonly* dalled culturally deprived are in the city of Dunkirk, 
New York? , ' • 

Within more recent years, the findings of Piaget's works are an 
important part of research in stience education. This study plredates 
miich of this work, but .certainly shoulc^ be noted and built upon in the 
future. It giv^s credence to both current methodology and curricula in 
science education. The researchers. Raven and Strubing, have recognized 
important findings in their study and have attempted ^to cite appropriate* 
limitations • Of equal importance is the merging of the works of. Thorn- 
dike, Guilford, Gagne, and Piaget, among others, into a study that 
attempts to provide a Kasis for teaching and curriculum develo{^ment in 
science education'. 



18 



22 



Raven, R. J., and H.« Polanski. "Relationships , Among Piaget's Logical 
Operation^, Kience Content Comprehension, Critical Thinking, and 
.Creativity." Science Education : 58(4) :531-54A, 1974., 

Descriptors~*Cognitive Tests, *Compreheusion, *Concept Forma- 
tion, Creative Ability, Critical Thinking, *Educational Rese^rcfe, 
Learning Theories, *Measurement , Models, Science Education 

^Expanded Abstract and Analysis Prepared Especially for iTs.E.xljy Anton 
E, Lawson, Ji^rizona State University at Tempe. 

Purpose * , , 

The^urpose of this study was to describe some relationships 
between a^Piaget-based model of content comprehension and other types 
of cognitive processes tha&^av^ been related to comprehenstoa* Two . 
questions were asked: ^ ^ » 

• Is there a positive relationship between science content 
comprehension, creativity, critical thinking, and Piaget's 
logical operations? 

2. Do children's sc^^nce content comprehension, creativity, 
critical thinking, and lo-gical operations differ between 
♦ fourth grade and sixth grade? 

" ' • ' ' y 

The major thegls^ this stfudy is that the student himself must 
impose some sort of restructuring of the science content before he can 
meaningfully comprehend it. This notion stems from Piaget's epiBtemo- 
logical position that to know something is to act upon it. Presumably, 
in order to restructure science content — that is to comprehend it — the 
Piagetian logical operations involved 1^ classification, seriation, 
logical mi^tiplication, compensation, proportion, probability, ^ and 
correlation are used. If these operations are lacking or poorly developed, 
then the ability to restructure science content will also be lacking or 
poorly developed. Therefore, science content will be poorly comprehended.^ 

Thfe present st^idy is, in effect, an attempt to gain some empirical 
»i«pport for this thesis. Raven and Polanski call this thesis the "logical 
operat^.ons science content comprehension development model." 

Research Design and Procedure . ^ - 

Support is sought for this thesis through a study of the intercor- 
relations of five criterion measures. The five measures were: 

1. Science Content Comprehension Test - developed by Raven and 
Tolanski; ^ , 

^ 2* Torrence Teats of Creative Thinking - verbal and figural 
. tests; ^ ' ^ 



3. Cornell Critical Thinking Tests^^- conditional reasoning and 
class reasonina; ' . 

4. Iqwa Test.or"laAc Skills - vocabulary . and reading 
comprehension • ' ' ' ' 

5. yR^ven's Test of Logical , Operations - developed by Raven. 

The tests were administererd to 111 fourth grad^ students and 109 
sixth grade students of slightly, above average IQ. *The socio-economic 
level' of the .sample was described as ranging from low middle-class to 

hleh-^ middlo-cla s a , — ^ive- testing^ yirttiattdns were ser up for each grade, 

•Each testing «itu^tion lasted approximately one and 'a half hours with 
a break midway through tlhe^ session. One testing session was held per 
week ior each grade. - The investigators administered the tests. 



Finding s 



1. Test reliabilities detentfined by Hoy t*s, analysis of variance* 
were 0.85 for the Raven^s Test of Logical Opierations; 0.82 
^ fo^ the Science Cont^ent Comprehension Test; and 0.89 for the 
Iowa Test of Basic Skills (romprehension) ; The scoring 
validity of the Torrence' Tests of Creative Thinking were 
determined by factor analysis. Since the analysis yielded 
results consistent with the tests V constructs, it was con- 
cluded that the tests had adequate reliability. 

£• The Science Content Comprehension Test correlated: at 0.6^ 
\' with the Raven^s Test of Logical Operations;, at 0/69 with 

the Iowa reading comprehension .test; at 0.34 with the class 

reasoning test; at d.42 with the conditional reasoning test; 

at 0.32 with the Torrence verbal test; and at 0.14 with the 

Torrence figural test. 

*3. The means for the criterion tesfcs (and subtests) generally 
increased from fourth grade to. sixth grade.. Univariate F 
^ ratios comparring mean scores reached significance (p < .001), 

for 14 of the\19 subtests. . i 

4. Multiple correlation coefficients between the subtests of 
the Raven* s Test of Logical -Operations jind several, of the \ 
other mea3ures were reported. The reported 'coefficients ' ^ 
ranged*from O: (51 for the Science. Content Comprehension Test 
(40 percent of variance accounted. for) , to 0.23 for the 
Torrence f iguralAtest (18 perceht of v'arianc^ accounted for). 

\ ' 

5. A factor, analysis joKseve^ pf the measures was reported. 
A factor identif ie^d-^s a "comprehension** factdr accounted 
for 13 percent Off v^the variance. The classification and 
logical multiplication subtests of . the Raven's Tefet of - 
Logical. Operations showed moderate loadings on this factor. 
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Interpretations 

• 

The. authors , interpret the high correlation (0.69) between the Science 
Content Comprehension Jest and the Towa reading ecmprehension test to 
indicate that the student is using r,eldted operations in answering ques- ' 
ticms on both tests. ;The high correlation' (0.59) between the Science 
Content roiapreheubloti^ Test and the Raven's Test of Logical Operations 
suggests; that it is lifiportant to consider 'the role of , these logical opera- 
tions iiy^clence .content comprehension. * ^ - ^ 

The finding that the classification sybte$t of the Raven's Test of 
Logical Operations acc owte d for a substantial portion of the variance of 
the 'class reasoning test was expected since the class reasoning process 
involves the grouping of objects or events-and the coHStruction of new 
group relationships. The positive relationship between the probability 
subtest of the Raven's Test of Logical Operations and conditional treason- 
ing test was explained by the assertion that the conditional reasoning 
prbcess uses words such as '*lf'' which h^\ie a probabilistic characteristic; 

Low intercdrrelations between- tests, such as the' figural creativity 
test and the Science Content Comprehension Test (0.14),»and the figural 
creativity test and. the lowas reading compii^hension t^st (.0.15) were 
accounted for by the difference in test formats. ^ ^ ' 



/ * !rhe results of the factor analysis, which showed two subtests of , 
the Raven's Test of Logical Oper^ons loading on a factor identified 
^s a "comprehension," were Inte^reted as support for th^ argument that 
the prodess of resttucturing. of^ given information is common* to a^ variety 
, of comprehension operatiop^. 

. The finding that the sixth graders performed better than the fourth 
graders on most o|f ek^ criterion measure subtests was consistent with 
the authors' expectations based upon their interpretation of Plaeet's ' 
theory . , 

The authors concise, that their findings strongly support, the 
validity anfd usefuln^s df.the logical ^peraticms science content com- 
prehension developmental model. This conclusion was drawn since the 
model was used to d^slgir the ScUence Comprehension Content Test and tMs 
test was found to cbft^elate significantly with the other measures used 
in the study. ^ . , , 



ABSTRACTOR'S ANALYSIS 

Rav^n afid Pblanskl offer an Interesting thesis. Following Pikget, 
they are hypothesizing that an adequa|||> comprehension of science content- 
requires the leamer'^to Impose some sort of restructuring upon that 
content. This restructuring presumably Involves mental operations such 
as classification, seriatlon, logical multiplication, proportions, 
correlations, and so on. 

Unfortunately, one cannot be sure just what Raven and Polanskl mean 
by restructuring" since no examples of such test items were given. The 
research teport would have been more informative if examples had been 
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^ . given. Nevertheless, I suspect that they mean that the student must In 

, some way be alrle tq "operate"' with the content for that content to be 
adequately comprehended. In a sfense, adequate comprehension is being, 
defined as "operative knowld^ge" as opposed to atatlc or "figurative" 
knowledge in the Ptagetian sense. If the Piagetiah operations required 
for'ope'tative knowledge are lacking' 6r poorly developed, c^prehension 
, will suffer. For exaijiple, to understand the concept of biological 
succession, the mental operations involved in serial ordering are needed 
,to place prlant and animal types into a serial arrangement through tzj^e. 
Or, to understand the quantitative relationship between the strength x>f ^ 
^ ■ attraction cfT molecular particles and their inter-particle distance^ 

the mental operations involved in proportional reasoning are needed. 

* ' ... 

/ 'This general thesis seems to me to be of great 'significance. . We 
have 16ng suffered fronj the problem of teaching content t^atj for-s-ome 
reason or another, simply was not adequately coaprehendefl. Piagetian 
, theory provides an hypothesis to explain'^ this lack'of comprehension 
♦ (cf. Lawson and Renner, 5). Further ,. necessary steps are suggested to 

correct tliis^dif ficulty . Namely, design instruction . to explicitly 
teach* these operations [e. |., Raven (9); ^Lawson and Wollirfan 46)]. The 
result' of such instruction would be studentsji^aified with the mental ' 
operations necessary for science content con^rehension. 

Notice that this model of science content comprehension, necessarily 
precludes the teaching of certaUi theoretical concepts to young elemen- 
' tary school students. These students, who generally are just beginning 

to develop proficiency with concifete operations such as classification 
and seriation, a^e a long way from developing proficiency with formal 
operations ^§uchjjds prof ortiijans , correlations, combinations, probability, 
and so on. Acceding ^,o 'this *view of content comprehension, these 
formal .operations woiild be needed to meaningfully cpmprehend certain 
' ' theoretic^ concepts, presumably because ^our reasons for believing in 

the validity of such concepj^s depends- upon analyses of data.^using these 
operations. If students have no facility with trftese formal operations, 
they would have no way of comprehending the natur^of such concepts and 
our basis for belief .in such concepts. Their knowledge would have to 
be based upon faith, rather than upon evidence and upon reason. Also, 
their knowledge would be static (figurative), rather than operative. 
Further, the premature teaching of such concepts most likely would r¥)f / 
. • result in the development of formal operations. 

It should be noted that not all science educators would agree with 
this restriction upon the teaching of theoretical concept's. Novak (7, 
8)rfor instance, uses Ausubel-'s theory as a basis for his argument that 
Children can "acquire" theoretical concepts well before they reach 
Piaget's stage 6f formal operations. Novak, however, fails co explain 
Just how Ausubel's theory can be used to Justify such teaching and why 
Ausubel himself, acknowledges the necessity for formal operations in 
^ ' such learning situations (e,g.^ Ausubel,. 2:149; Ausubel, 3:279; Ausubel, 

4:261; Ausubel, 1:219-220)* 

Having said, this, let us return -to the present investigation. Just 
how much support do the data give to the Raven *Polai>^i thesis? In my 
judgment, they lend some support, bi^t not much. ^^^ts the abhors suggest, 
the strong relationship (6^.62) between the science Content j:omprehejis ion 
Test and .the Raven's Test of Logical Operation's could be ac'counted for 
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simply^ by the fact that both tests were designed to require the use of 
the same logical operations ^nd not because the operations are necessary 
for science comprehension. ^- ^ . 

*» _ *~ 

The authors go on* to ^st^te that the strong association (0.58) 
between the Iowa reading comprehension test and the Raven's Test of 
Logical Operations negated this argument since the constn|ction oi^he 
^pwa reading comprehension test dx5 not^ use the logical operations 
model in its development. This argument, however, seems iii error since, 
the authors J:hemseives reporr that 20 percent of ^e^ items 6n the Iowa 
reading comprehension.^est dij Involve thesjlogi^ax operations' found on 
the Sciengf Content Comprehension Test.* The correlation between' the 
low^ test and the Science Content Comprehension Test coWLd then have 
been due l^rgel;^ to that 20 percent of, items involving the same opera-»- ^ 
tions, rather^ than, the need for tho^e operations in comprehension. 

Further, it should be pbinted out that, although the Raven's Test 
of Logical Operations and the' Science Content Comprehfefcsion Test did 
correlate moderately with ^ number of other tests, these moderate 
co^jrelations need not be attribaited to the necessity for xestructuring 
operations as the authors argue. They could be att/ibuteTl to the 
necessity for restructuring operations as the authors argue. They coijld 
be attribu^ted to a general test taking ability, verbaMntelligence, or 
some sort of "g" facto'r. ^These general factors .normally account fpr a 
substandard portion variance in many such studies and .must ba acknow- 
ledged.. The computation of partial correlation coefficients with, say, 
verbal intelligence partialled out, would have been more informative.. 
<The computation of correlations as a^iwothesis testing tool ^s useful, 
however,'*^significant limitirtions of tra^niettrod exist. 
• • • 

In conclusion. Haven and Polanski'have suggested an extremely , 
interesting' thesis about thgi relationship between Piagetian logical 
operations and science content comprehension. They have obtained some 
support for* their thesis, however It must be. tested with^more complex 
researcK procedures before ^ts validity can be convincingly established. 
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Purpose 



The stated purpose of^ this study was "to evaluate the extent to 
which disadvantaged junior and senior high school 'students have 
» developed selected concrete and formal conservation concepts and to 
evaluate the extent to which they have acquired* fopnal operational 
rea'feoning ability 



Rationale 

Four sequenti^ stages of cognitive development are postulated 
In Piagetian tll^ofy, namely: sensorimotor, pre-operat^onal, concrete, 
and formal* operational stages. Davelppment within each of the stages 
follows a fairly predictable path J. (a) ap initial experimenting phase 
during which strategies of experimental interpretations are acqui 
(b) the progressive accumulation and eTi^oration 0f advance^ techniques 
affirmed by experimentation, and *(c) a restructuring and consequent 
extension of existing cognitive structures to incorporate the newly 
acquired strategies. 

"~^t' eleven or twelve years' of age there is a transfoifmation in a 
child's thinking from concrete to formal thinking. -Up to this age tfie 
T)parations of intelligence are "concrete," i.e., they are concerned with • 
tangible objects that can be manipulated and subjected to real action. 
Ad of eleven or twelve years the logical operations begin to be trans^ 
posW from. the concrete to the ideal or formal plane. Two cognitive 
skills underlie formal operations — the abtlit^ to subordinate the .real . 
to possible and the ability to reflect on bne's thought. 

While the ages at which children's cognitive development is 
transfprraed ^rom one stage to the next vary Jrom culture to culture, the 
order is invariant. The investigators cite^ studies which show that 
"rates of attainment of . concrete reasoning ability (by children) . . . 
vacy significantly With socicJeconomic level as well." • ' 

/ ' ' . 

Research Design and Procedure ' , - 

. Disadvantaged students randomly selected from two separate 
popul^ions attending , urban schools wefe administered ^Piagetian tasks 



Itl individual interviews to determine the extent to whicR thtay had 
acquired formal operational reas^oning abilities. One sample consisted 
of 96 students (ages 11.4 years' to 14.4 years: mean age = 12.6 years) - 
enrolled in seventh grade science classes at a predominantly black and 
Spanish- American junior high school.* The othe^ sample consisted of 
506 science students from a predominantly ^lack senior high school. ♦ 

The tasks, all of which w^re administered in individual interviews,, 
had been employed by previous Plage^tian ' investigators. Thus, only brief, 
identifying descriptions of the tasks and materials were included. 

If a student was found to be a nonconserver o-f weights he was given 
tasks on -conservation of valumercTay, conservation of volume-metal 
cylinders, separation of variables, and equilibrium in the balance 
(7th graders) or exclusion of irreJ^evant variables (high school students). 
The formal separation o£ variabiles, equilibrium in the balance, and the 
formal exclusion of variables" tiasks were designed to meeisure formal 
reasoning abilities. - ^ . 

Criteria used in classifying a studen,t*s responses to each of the 
tasks and the corresponding point sdores are described. Two points were 
awarded for successful completi<)n of a conservation task — one point for 
a correct conservation response and one point for a correct explanation. 
A total of three points each was possible on the formal reasoning (exclu- 
sl^ of va^ables, iiceparatiori of variables, equilibrium in the balaryte) 
tasks. Criteria for classifying and awarding points for responses /o the 
formal reasoning tasks are described adequately for replication by persons 
familiar with^the tasks. Subject response's to each task were categorized 
and points* awarded as follows: 

II A Early Concrete Operational 0 .points 

II B - Fully Concrete Operational J^^^^ipt 

III A Early Formal Operational 2 points 

III B Fully Formal Operational 3 points - 

The total interview scQre for a subject was calculated by summing the 
individual task scor'es. Due to the number and nature, of the tasks 
administered, the Piagetian operational levels of thought and the range 
of scores were as follows: 

6-1 points Preoperational Thought 

2-6 points II A Early Concrete Operational t 

(Three conservation tasks — area, length, 
weight) 




7-14 points II B Fully Concrete Operational 

(II A tasks and two formal tasks awarded 
1 point each^ 

15-20 points III A Early Formal Operartional 

(Two conservation of voitune tasks and 
two formal tasks) 
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21-22 points ^ III B Fully Formal Operatiijfal . „ 

(III A and successful 'completion of, the 
separation and exclusion *br equilibrium 
tasks) ' — ^ ' . 

The highest possible score for the n^nconserver of weight was 10 points 
earned by conservation responses and cbrrect explanations for the 5 
remaining conservation tasks oHnyWhich from 60 to 9& percent of the 
subjects were successful. ' 



findings . } ' ^ 

In general, the two groups of students performed similarly. Between 
'#►91.7 and 97.9 percent of the sub*jects, were successful on the conservation 
tasks; number, continuous' quantity, and substance. A second group of 
tasks of similar difficulty (between 47.9 and 72.9 percent) frrcfuded 
conservation) qf area, length,, and weight. Only 3.Lto 11.0 percent of . 
the subjects demonstrated conservation responses on**the volume tasks. ^ 
Data were not reporteci for success on the formal reasoning tasks. 



^ , ' Percentage of TOTAL SAMPLE 

Piagetian 96 Sl^venth 506 Senior 

Level Grade Students High ^tudehts 

I Preoperational 1.0 ^ 1.0 

II A Early Concrete Operational 16.6 ' 16.8 

II B Concrete Operational 66.8 69.0 

III A Early* Formal OperationaL 15.6 13.1 

III B Formal Operational 0.6 0.1^ 

' Accbrding to these data, the majority (84.4 ^d 85.8 percent) of 
these 11.7 to 20.0 y^ar old subjects were concrete thinkers. Only about 
13 to 16 percent of ♦these subjects demonstrated evidence of formal 
reasoning ability. Correlations between subject agels and the total 
Piagetian task scores were reported to be near zero for both the junior 
hifeh school sample_(r ■ -0.03) and t^ie Senior high school subjects 
(r«0.00). * . 

Interpretations ^ ^ 

"These results suggest that the lag in acquisition of Conservation 
concepts in disadvantaged primary school > children continues and probably 
beconKS greater in disadvantaged adolescents. The finding that only 
about. 13 to 15 percent of these subjects demonstrated any evidence o% 
formal reasoning ability coupled with the lack of correlation with age 
Suggests that, fy the majority of persons in this segment 6t society, ' 
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* I . ' ' ' ' ' 

formal operationJi 'skills, will probably njever develop^ under existing 

''conditions" (p.' 574)-. * . ' * .| ' ' ^ 

'Questions concerning appropriate kiqds of instructional methods 
, and materials for this type of student s4em iifdeed- crucial. While a 
person is in the concrete op#_rational ^age his thinking and understand- 
^ing is restricted to/what he' can phNrs/qally ♦se'e, feel,' and expi^rieace ' 
in first-hand situationlj^ He id ,ur^51e to deal with , abstract concepts 
or pr.ocesses. Therefore.it is imperative that cla^room aittivities , in* 
such subject^ as science; involve concrete materials of the discipline. 
Fo^ concrete thinkers to develop meaningful understandings, the laboratory, 
- not the text]>ook, nius^ become' the major scy^rce of information and provide 
the^'asis for discussion'* (^p. 574). ' . . , / 

■ ' . •. '■ ■ • <J 

ABSTRACTOR'S ANALYSIS • ' 

^ This study addp a new^dimeh^ion to a large and rapidly growing bqdy of 
research on the Piageti^a/model of .cognitive' development.. It extends to 
adolescents the 'findings ^f studies which repdr.t "signifitant socioecono- 
mic differences, in young childten'§ acquis! tiqn of conservation concepts'' 
(p. 569)* The finding that 'a majority of the disadvantaged adolescents in 
the#secondary school science classes in this study demonstrated no evidence 
of formal reasoning caiitributes to'^a theoretical basis which should be of 
importance to curriculum developers and classroom feachers. 

In his comprehensiv^ummary. of Piagetian research^ Modgil states, 
"Perhaps in no ot^her area of psychology is there so (nuch-' cross-cultural 

• and ctoss-social-class empirical research data available as on the 
Piagetian ta^ks*'. He concludes, 'Ijowever, with the evidence availabTe 
do faf, it is diffici^t to make any sweeping statements about cross- 
cultural replication of Piaget's findings^. There are problems in 
Interpreting the results from cross-cultural studies, partly because of 

, differeaces *in language and^T>fcrtly due to experience' and cultural^ 
values" (5:226). • ^ \ - * 

While the cross-cultural and cro^ss-social-class research cited by 
Modgil is extensive, it is -quite diverse. Only a small number of studies 

• have included U.S. bLacks and other groups identified as disadvantaged. 
Except for the present study, the subjects have been young children. ' 

.An investigation cite^ in su^ort of this study was by^ Waisk and 
Waisk wha -reported that for culturally disadvantaged primary children 
aggi^ition of a variety of concrete conservation tasks lagged- 1 to 2 
ye^rs behind the a§es at which such concepts are mastered by middI^--^ 
class -children" (6:1587). > No similar comparisons can be made from the 
. present study sii\ce it was Limited to disadvantaged (predominantly black) 
science students. According to the Campbell and Stanley (1:176) noMn- 
ciature, it is a One-Shot Case Study which provides considerable ^ 
informatiorn about a single population^ butt for which caution must be ^ 
♦exercised in drawing causal or comparative inferences. 

Spaceylimitations that are imposed on the authors of any journal 
prticle oftep leave unanswered many details and questions regarding the 

'\ : ' \ ' ' ^ . " ■ 
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research design and .investigative procedure which,, while appearing tcJ be 
^relatively trivial, <;ould be important to, persons conducting^ replication 
studies. ' , ' » . • 

Two unstated assumptions appear to have been made by/ the 
investigators. The first is that all students attending 'the two schools 
and participating in the stud^ were disadvantaged. If this fact was 
establi^shed empirically, the operational definition of "disadvantaged'*" 
and confirmation that the subjects were indee<ti*d±s advantaged would add 
to confiiienceiin the findings. ' • * ' 

A second assumption is implied in the title of the journal article 
in which research data from two populations of science students attending 
predominantly black and Spanish-American urban achools have been . 
generalized to "disadvantaged junio'r and senior high school students." 
Predominantly black and Spanish-American implies that students from other 
raqial or cultural groups attended the schools from which the subjects 
were selected and could have been participants in thp study. SiAce race 
and cultural group references were_used in the journal ajrticle to define 
disadvantaged, an analysis of the school population and the subjects of 
the study by race and cultural grou^would be helpful in intetpreting 
the" findings. , ' ' • . ' 

A study by Gaudia (2) suggests that there is a difference among | 
lower-^lass environrgents of racial groups that affecbs performance on \ 
Piagetian tasks. Us'ing subjects from several schools in Western New 
York state, he found that "Negro childreit performed at a lower level of 
conservatix>n than Indian and white • children" (2:163).^^ He argued^ that 
"this inc^reasing difference between racial groups with increasing 
chronological age suggests that environments may be entirely different 
among races" (2:163). Piaget claims that environment is a factor in 
cognitive development, but a relative^^y minor one and then only when 
the cultures are widely divergent. Until empirical data lead to a 
rejection of racial differences due to differing environments, catition 
should be exercised in generalizing from a sample representing one ort 
* t<?o disadvantaged cultural groups to all disadvantaged students. Also, 
the possibility racial differences in conservation due to differing , 
lower-class environments raises questi^pns regarding the validity of , 
combining urban black and Spanish-American students into one group of 
disadvantaged students. • ' 

^ Inhelder, Sinclair, and Bovet conclude that "differences in the 
ages of acquisition of various concepts have been frequently noted in 
cross-cultural research and seemJ^ to be governed by the amount of cog- 
nitive stimulation the child receives in his everyday life" (4:128). 
The present study provides little in^formation about the everyday 'life 
of the subjects or data on their psychological, cultural, academic, or 
cognitive attributes other than performance on the Piagetian tasks. > 
Could such data provi'de clues for the finding that the senior high schpcrl 
subjects performed less well on the conservation tasks than did the 

' junior high school subjects? , • 

For persons familiar with Piagitian ^esearth, the journal article 
adequately defines the conservation and formal reasoning tasks via a 
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pani^raph devoted to each. These tasks have been employed and described 
by marfy investigators". While the t&sks are adequately defined, the con- 
ditions of the interview and the interview technique necessanily yairy - 
from study to study due to different physical facilities, deferent 
persons conducting the interviews, and p6ssibly different ways in which ' 
the tasks' are administered/ A* derailed descriptiotf of the interview 
procedure followed in the present study would permit comparisons to. 
other studies and make replication possible. It would be useful to know 
how the interviewers were trained, the^ degree of experimenter variance, 
whether or not a given interviewer interviewed the s^me proportion of 
subjects from each of the two populations, how the students were intr:o- 
duced to the tasks, and the procedures u^ed in^redording the data,. 

4 

An effect of interviewer technique in performance of the subjects^ 
is reported ty Inhelder, Sinclair, and Bovet wbo state that '*in the 
experimental situation it is often necessairy to repeat the /question 
seve^ral times in a variety of different ways, so as to elicit' the use 
of unfamiliar types of reasoning" (4:128). Greenfield and Bruner (3) ^ 
report that many unschooled subjects were led^from nonconservation^to 
conservation when the child himself carried out all the actions with 
the liquid conservation rather than observe the experimenter do so. In 
the present study the "disadvantaged" subjects are likely to have beevt 
unfamiliar with the types of reasoning required by the tasks ,and may 
have been led from nonconservation to conservation had there been an 
opportunity to carry out the actions with the materials. - 

A basic criterion of statistical analysis .appears to have -be^n met 
by the fact that the subjects "were randomly selected from seventh g'rade 
science classes" and were "randomly selected science students from a 
. . . senior high school". (p. 569). It would be helpful to know if the* 
sample was randomly selected fro6 the set of all of the students in all 
of the Seventh gr^de science classes and from all of the high ischool' 
science studehts. Assuming that this was the case, it wouldjJ)e inter- 
esting to know the rationale for the numbers of students (96^and 506) 
who were selected as subjects. , ^ . ^ 

In summary, the study is described succinctly ariJ 'concisely , giving 
the reader a reasonably clear description of the stuSy and its findings 
within the space limitations imposed on the authors of a journal article. 
The findings are clearly reported in graphical and* tabular form and the 
conclusions 'are consistent with the data presented. Several important 
impITcations" for science teaching are considered. 

A relatively small ^unount of research has been conducted to determin 
the Piagetian level o^ cognitive development of junior and senior high 
school students who are comijonly taught science* and mathematics as if 
they are* at the level of formal ijeasoning'. Further comparative* studies 
appear to be warranted to determine the extent to which cultural and" 
class environments affect fopnal reasoning ability. ^ Support for such 
SJtudies is provided by Inhelder, Sinclair,' and Bovet who conclude that 
"investigations in the ^ield of the* role of \:ultural environment on the 
process of operatory development is on^y in its infancy and much more 
research is needed" (4:270).- 
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Purpose 



•The seated purpose of this research was to investigate children's 
understanding of specific types of electrical phenomena (i.e., electro-^ 
statics) and the extent to which children used modoj^or analogies in 
their explanation. 



. Rationale ^ ' 

Research Into young children *'s understanding of scientific concepts 
and phenomena has been conducted over a number of years. Studies have 
been conducted vhich indicate that children use models to explain vari- 
ous ^types of phenomena." Thus, children can be classified as modelers 
or nonmodeiers based on their responses to questions about specific 
phenomena. This inyes ligation is an extension of these studies relative 
to electrostatic phenomena^ 

Research Design arid Procedure ^ ^ ' ' 

A total sample of 57 pupils were' randomly selecte^Tf rom 
elementary school population of 405 in grades two through 
were shewn three demonstrations: (D a charged *on^ pj 
pieces of paper, *(2) a charged balloon sticking to a^A 

simple circuit being opened and closed by a switL^chC After each^detnon- 
s'tration five (Questions were asked; 

• 1. What did you see happen? » ^ . 

2. How would you explain what happened to another student? 

3. What do you think the comb (balloon, switch) might like 
for it to work the way it does? / 

' / 

4. Do you think your explanation would .help another student 
understand what tiappen^d? . ^ 

5. Is tJiere anything else you would like to tell me' about the 
■ demonstration or how you would explain it? 

All pupils were intervielOed individually and their ^g^ponses were 
recorded on audio-tape. The tapes were analyzed to determine if the 
pupil used a model to explain the observed phenomenal Accuracy of 




responses was not considered. The pupils were interviewed tintil there 
were at least jeight pupils in each of the categories (modeler and/or 
^noomodeler) , A pupil was classified as a mqdeler if he used a model 
*in at least two^^^xplanations. ^ 

« 

Findings 

' ~ - / ' ^ ' 

No traditional statistical treatment was used to analze the data. 
The data were Summarized in terms of the number of pupils InteTviewed 
and classified as modelers. It was found that no pupils in grades two ^ 
through four used models or analogies in the explanation* of the 
phenomena. Approximately 50 percent of the fifth and sixth graders 
used mo4els in their explatnations of the demonstrations. 

r • . ^ . 

Interpretations ^ ' ^ * * - 

The findings of this investigation confirm the results of previous 
studies in that elementary school pupils can and do use analogies or 
models in their explanation of selected phenomena. It is suggested 
thajt the reason that children below grade level five do not use models 
is because of instruction. This was concluded because some modelers 
stated that they received instruction in atomic structure while those 
in grades two through four did not make similar admissions. Thus, it 
can be concluded that the use j^i models is probably due to instruction. 

*> 

ABSTRACTOR'S ANALYSIS ^ ' ^ 

, While this is a nice little investigation, it dqres not really tell 
us anything that we did not Icnow/already . ♦t appears to be a^repeti- 
tion of the work of Zeigler and Anderson who are referenced in the 
introduction of Mclntyre's article. It would have been good if the 
Investigator had discussed his findings In relation to the studies, 
cited azul the contributions this study makes to this area under ^ 
^'ffivestigktioif'. ^ 

One shortcoming of , the study is , the description of tlje sample used. 
A major objective in reporting research is to provide sufficient infor- 
mation 60 tljat the study may be replicated if indeed this is desrired. 
However, /in light of this description, this could not be done. Thus, 
*t is also difficult' to generalize to other pupils because of this lack 
of inft^rmation. ^ 

» 

The investigator goes on to state that substantial numbers of 
pupils in grades five and six use models in their explanations of 
selected electrostatic phenomena. While this appears to be overstated 
(50 percent and 53 percent respectively), it is difficult to form any 
conclusions about Children's use of models in explaining phenomena. 

N^p> the investigator suggests that modeling and the use' of 
models^s probabJ.y due to instruction. How does , he arrive at this 
conclusion? By stating that the pupils made mention of bits and pieces 
of infortoation ibobt the t9pic of previous instruction. However, this 
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was not pursued in the study. Yet it was used to riake a conclusion. 
This is a bit shoddy and should not have' been Incluled since this was 
not really an important part of the study. • Nor was this information 
actively sought as evidenced by the questions asked during the inter- 
views . ' » . . 

Reference is made to a "study of the. effectiveness of different 
types of models in ^^lassroom instruction." Howevrf?, this h^s no direct 
befaring on the investigation reported. Why this'i« mentioned is not 
clear from the body of the paper. 

Finally, it is concluded that the study not only confirms but 
extends the idea that elementary pupils use models in their^explana-- 
tion of phenomena, byt this is never really explained beyond the 
research cited. It would have been helpful to the reader to expand bfv 
this in the "Discussion" ^ectic?n. This was not the case dn this 
article. ' ' ' ^ 

An interesting question to \hi:s abstractor is: Why did the 
investigator choose the number of 6ight pupils for each occupied 
category? This is never really"^ explained. Since' the investigator did 
not use traditional statistical procedures for data analysis, why "the 
choice of eight pupils as a minimum? This should :have been explained 
since it is not' evident in the article. 

In conclusion, the questions raised above need to be Explained if . 

4 he reader- is to receive a good idea of the sense of this investigation, 
he article does have merit but has^not been reported properly. Finally, 
the "Discussion" section should be used to discuss the implications of 
the study. ' fhls i^ould have clarified some of the questions^ and points 
raised about the article. ' • ^ 



Robertson,- W. W. , and E. Richardson. < "The bevelopmeht of Spme Physical 
Science Concepts in Secondary School^ Students.^" Journal of Research 
in Science Teaching , 12 (4) : 319-329 , 1975. . 

Descriptors~*Cpn;aeryat>ion-' (Concept) , Educational Re'sedrch, 
Learning Theories, *Physics', Science Education, Secondary 
Education, ^Secondary School Science, ^Sequential Leamlrrg 

Expanded Abstract and Analysis , Prepared Especially for Ti'S.E. by 
Milton 0. Pella, University of Wisconsin. 



Purpose , ' . ' - 

To replicate and extend a' numb^er of tests of "conservation** of some 
^hjjcics concepts; to measure the conservation of ^ some concepts not 
previously tested;#to administer with st^dardized procedures '^he tests 
on. a group basis, checking reliability with standard- clinical testing; 
and to investigate predictions bashed* on hypotheses of the hierarchical 
attainment of concepts in physics. 

Specific hypotheses are: 

v-^^x^ A. If the conservation of derived quantity in physics is dependent 
upon the prior conservation of constituent quantities, then 
students will conserve: • . • 

1. mass before weight 

2. length before area ' » 

3. length and time before Speedy , 

B. If the conservation of a derived quantity in physics is depen'dent 
upon the prior conservation of its elements, then students, will 
conserve: * , V ~ 

lyj^ length and area before volume * ^ 

2. mass and volume before density ^ 
S.^rea and* force before pressure , 

4. mass and acceleration before the force relation'ship (F = ma) 

5. force and di^ance before '^he work. releatioMhip (W •'"Fs). 

Rationale . . 

while much is now being made of the hierarchfcal structure within' 
science in curriculum projects and the stages or levels of cognitive 
^ development in learning theory, little research evidence existk-in 
relation to such basic questions as: (a), are science concepts attained 
in .particular hierarchical sequences, and (b) is the conservation of a • 
derived quantity in physics dependent upon the prior conservation of 
the fundamental quantities — mass, lengthy and time? , 

The present research is related to Piaget's genetic approach to 
cognition and work doile by Elkind; Lovell and Slaters ^Lovell, H^aley 
and Rowlandj^Lovell, Kellet and Moorehouse; and others concerned with 
deyelopmerfra. stages* s * • 
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. Research Dgsign and Pjocedure - " ' ' 

~~~p ^ r. ^ • 

• A sample of 25 boys and 25^girls was randomly dravm frcyp each of 
grades 7 to 10 in orve school giving a stratified sample ^ 20O, The 
mean JQ was 107.^ (S.D. 11.9^. with no significant difference between 
samples for eady grade. , ' 

. The concepts - mass, .length, time; weight, area, speed, volume, 
deMity, force; pressure, acc^eration, force, and work - were selected 
fof study as a result of analBjLs of fhe concept "energy." A group of 
tests for each concept sequen" was developed. The pupils were tested 
in gjoups of 25, utilizing procedures to minimize subject-subject 
interaction and ieaming through tests.^' Some of the tests were modifi- 



cations >.c;tf;t^sts ^^ed by other investijltors— Elkind (mass weight and 
volume), J^ovell and Slaters (time) Ll(|ell, ^Healey and Rowland Cdistance 
and length), and Lovell, - Kellet and Moorejjouse ^.(speed) . % 



e:i^. 



The results were based upon childi;en*s p 
lanations as signs of conservation. 

ibiting conservation according^tr'^he following criteria: 



^w, 4,^-^ctions, judgments and 
Each subject: was classified as 



Conservation: The ^subject responded corri 
questiotis related to the task. 



the 



2. No^conservation: * The subje ct^tnak es 'one or more* errors in 
prediction, judgment or exp^anatit^.* 

The classifications were subjected to ^calogram' analysis. The 
critj^rion used for assigning the conservation of a quantity to, an age 
livel is the age or grade at which 75 percent conserve. . ■ 



Findings 




1. The 75 percent criterion was ebcceeded at grade 7^y boys 
'* anld ^rls for the cc^n^epts": jnass^ weight, weight-force, length, 
distance, sp^ed (straight tunnels) and speed (concentric circle), 
In addition, at grades 8 vertical height was conserved by both 
.o boys and girls, i^t grade 9 time was conserved by boys, and 
girls, but vollime by .boys only. At^grade 10 boys ♦conserve 
area. , ' ^ 

\ ^ \ ^ ' ' 

' 2.^In relation'to the g^eral hypotheses * the results of the 
^ concept attainment provilde ^idence^^c'on^ming^ possible 

hierarchical structures for>leaming phyiics.^ - 



Interpretations 
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Clfearl^ tha cops'erVation of derived quantity in physiqs is not 
necessatlly ji^penrd^H^pon ' the prior conservation of its jponstituent 



:ojiserv 
fun4amental tjuantities. 



Depending on the .choice of operational definitions ^escribing^basic, 
phenomena and^the logical Manipulations of thesfe definition^, 'different 
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patterns of the organization or ^toicture of the discipline *can be - 
built up. The research inAioates\hat time is not a first order ^coticept. 
Time is more removed from reality than speed. • * ? 

N:.,^The test^ of the conserVStidn of pressure, force, -acceleration,^ 
worr4fidrpdtential energy provide dramatic eyidence of the lack of- * 
understanding of these concepts. If a student is unaware of the' ' 
Invarient aspects of a concept in thfe face of transformations ^ his 



♦understanding is yery limited. Trerlp is much evidence of Vetbal* 



l^rping. ^ ^ ^ 

■ : * . ■ , ■ . . 

^ ABSTRACTORS^ ANALYSIS 

Jhis study compares favorably with'^Qthers of tVie type that 'are ; ^ 
og^Bfed with# selected idea^ from ^iaget?.^ The' testing ha^een carried 
^* ^Jl^ care and the data ^ave' been subjected to reason JB^nalyAis 
It may >e Assumed th^t.jfhe results of any research are ^?jijrlHple i^^ithe. 
measurement devices 'afe tellable and vali^. .It is %lsp ob'l^atory ' to 
assui|ie' that the results may lack crediUility if the data are curious. 

[y.- . ' . ^ ' ' I . ' 

Thib study, though^ nicely reported, except for the confounoin'g of " - 
the resu^s in the discus^on and the extreme statement , "pearly , the 
conservation of a* derived quantity in'^ysics is not necessarily 
dependent upon the prior conservation' of its constituent fnnd^ental , ' - 
quantities", presents the re'ader'lvith many prpblems. Some o^t^^se are: 

'^m ' * ' ' ' 

I. Their^ are no reports of ins'tmctional. programs provided for 
any. grade .level. » If there were* no programs of instructior| 

* the entire study is without merit. It is not po9«-ible for 
pupils in grades 77IO to intuitively d^v^lpp derived defini^ . 
tlojis and'linits as densit^^ force, pressure, weight, acceleration, 

• etc. ^ and also not^ possible for them to intuitively develop a" 
. " system in which length,^ mass, and time are fundamental to the 

. units derived; /. ' J^i 

2^5liere are no definitions o^ the terms predict , judgment , and 

explain ; *khe.^fundaiu'enrai& that make tip the d|ta* Was the term 
^ cfrredict ^ thjL^orec^ting of the'Jcture based upon use of 

" a* ^iven scientSiljfiS^aw in Which noncap«.cio'ushess' of nature\is 
^ accepted^ or something else?, Uid the ti^rm jujgment. meaa gue^ssr 

Intuition, or discursiv^ *reasonin^ Dfa the term explain m^arii ' 
* the Application of a scientific' liftrr tele^logical purposeful-'^ 
ness? The frequent lise of the 'term "why"*in th^ qyestions K • ' 
leaved the reader confused — is this the^ way of' the educ^itioial 
psychplogis't^-er, is' it, an attempt to get. to something else?^- 




3. Probably the most serious problem is the Use of the term ^. 
conservation . As one reads the report it^ becomes more and more 
impossible t:o*give. meaning to the results because the.-term is 
n6t ^used as in sciencefin the statement of the law^ ^ conser- ' J%r 
vation of energy, matter ,^ momentum, charge, etc. According to / 
^his study the notion of coi^ervation wds '*the al^Aity of the 

^ Wti^dent -<Q be aware of ^theJfcvarSlant, aspects of a concept in: 



the face of transformations." With this use' it must be * 
\ recognized that In /physical theories and laws, invariance 
' ^ . occur^ .relative to a frame of Reference; conservation occurs 

V within certain physical systems, namely closed systems. 

Within this paper and in the test questions there is no concern 
for the requirement of a system. It seems that the meaning attributed 
.to conservation in- this paper was that attributed^^^he tery equivalent . 
- There are significant differences btetween the two^^pepts, hence the 
results lack credibili-^y. Note the usje of. the concept of equivalence 
in the test items, '(a) The test for density involves two plasticine 
objects, one of which is formed into a cylinder. (6) The test for time 
involves two cars moving through tunnels of unequal length. (It is 
.also imj[>o8sible to have a^^ concept of the conservation of time in a 
non-relativistic s^steto, however, time equivalence is possible.) (c) 
Xhe use of force; as a conserved quantity is not reasonable.' \iote that 
force is a^ vector quantity and thus it has magnitude and direction. 
Reflect upon the common experience of using a simple machine; Unequal 
^ .forces may be acting. , The equivalence ide^ fs again present, rout now 
the idea must include moments; two trolleys are used and* comparisons 
• madel (d) Ac^pejerration 'is another npnc|||served -quantity and Wo 

trolleys ar'e^ used, 'ie) Vettical height is not a- conservable qua^^ity.^ 

in all oth^jp^nstances the right or' wrong answers depended upotis 
taowiedge of ,a' general physical law; in this case "the work done is 
IndepAdent of the path of the force." (f) .Conservation of work relates 
to conservation d energy since energy is potential work. Again two 
trolleys were lifted. 

« 

• In all exa3!iple;s the use of knoiN.edge of 1^\J& in physics woxild, and 
did, enable the^ subject to score properly; the subject could respond 
as equivalent pt not ^uivalent- concerning the two instancCjS. • 

^ At iio time wa^ the criterion of a system mentioned^ the subjects 
' were merely sAsked- to identify equivalents. ^The subjects were never asked 
to apply the concept .of conservation* to ej^ain observations; they were 
merely- asked to demonstrate a functic|nal knowledge of some physical 
law. • ^ . ^ ^ 

. \' , \ . 

The best that may be said from the results would bejt^t the 
* pupils did no% have mastery of the" physical laws applied in the problems: 

" ^ density » - d « vt, v ■ — , . p — , ^ f « ma, w ■ f x d. 
..^'V ' t .a ' 

^ It ds definite that; no statement may properly be made about conser- 
vation of energy, , conservation of matter, conservation of momentum, 
conservation charge*, conservation pf mads number, Ac.' * 

Ther'second cgncern was for hiararfchical structure for learning* 
physics. It seems that tl^ evidence, if existing at all, is weak to 
iaMc^Bi a possible structure for' learning physics. In order for the ^ 
resB^ititi to pi;oduce> meaningful jdata on- this, a variety of teaching 
. seq^jplfces would be pecessafy. <^Even thi^ procedure would be risky because 
each may be abased upon erroneous judgments, of the increments of a 
particular learning -product. « ' ' / 
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The conclusions exhibit some attitude of freedom to go beyond the ^ 
data: '"the results of measuremenrt of concept attainment sh'own in Table 
11 provide evidence concerning possible hierarchical structures for 
learning physics." On the same page the claim is "clearly, the cpnser- 
vatiqn of derived quantities Is not necessarily dependent upon prior - " 
conservation of its constitutent fundamental quantities. " ♦ 

There was essentially no experimental design. 

Although the data were treated as null hypotheses they were nort* 
80 stated* ' 

The authors expressed serious concern for the reliability -of the^ 
instruments used but ignored the important quality of validity. The 
data are no better than the instruments. ^ 

It thus seems that this project, though nicely conducted and ^ ' . 
reported, has produced little of value. The real problems come, from 
the confounding of the scientific concept of conservation* necessitating* 
a closed system concept ajid the concept of ^conservation as being efqa^iva- - 
lence. This confoundin^g is magnified by attributing the quality of 
conservation to quantities not really cohservad in physical manifestations,. 

The ideas of sequences qf increments of learning -n^eds to b§ 
researched for all science concepts, empirical laws, and theoretical 
laws. The first steps must be the identification or -the incremeA&e ^ 
and some means of measuring knowledge of .the increments. 

The consistent use of vague undefined tem^ will cctotitjfe to # 
produce confounding findings. \ {^^ ^ , ^i^"^"^ * 
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Kass,- Heidi. "Structure 19 Perceived Relations Among Physics Concepts." 
Journal of Research In Science Teaching , 8(4) : 339-350, 1971. 
Descirlptors — ^Cognitive Processes, *Factor Analysis, Factor 
Structure, Learning Theories, *Physics, *Psycholpgy, Research 
Methodology, -Scientific Concepts, Secondary Sphdol Students 

Expanded Abstract and Analysis Prepared ^specially for I.S.E. by Russell 
A. Yeany, University of Georgia. 

Purpose ; .* ^ ^ 

This study was conducted to determine the cognitive structur^of * 
^the' relations among 20 mechanics concepts (e.g., Newton's Laws, centri- 
petal force, centrifugal force, frictic^ and uniform acceleration) as 
•perceived by high school physics students. 



Rationale ' " 

Much sdciaJ science research haa been oonducteci on ^alyzing the 
degree of dif ferentiktl^ of the individual's personal structure and* the 
Influence which the nature of this structure exerts upon judgmental 
behavior. The author suggest^Nfhat consideration of such a conceptual 
basis foy judgmental beffiavlor should not be restricted to social cogni- 
tion. The students' perceptions of the domain of science concepts may 
influetice their judgmental behavior. Isolati'ng and ref^resenting aspects, 
.qf the cognitive structure related science conciepts should , be the first 
jstep in answering questions such as: How does Che structure of perceived 
^relations among the concepts affect performance in the subject?" 

^Research Des.ign^ and Procedure 

JThreeJi^undred fifty-three Grade 12 physics students rated the 
dif fer,ence in difficulty between 190 .pairwise combinations of 20 mechaifi.cs 
cOTicepts on a' nine-point scale from 1, very similar in, dif f iculty , to 9, 
very dif f erent ^in difficulty. For data analyses, the subjects were 
randomly assigiied to three groups of 67 in order to assess the extent to 
%rtiich one may expect to pbtain similar results across samples drawn from'- 
the same population. Fot each group, the difficulty difference ratings 
were arrayed* in a matrix consisting of 190 rows 'for the concept pairs 
and §7 columns for the subjects. The matrix of sums of 'squares for 
Individuals and sums of cross prockicts between individuals was then ^alyzed 
through principal component factoring. ' ' 

Findings J _ > 

Analysed of the Sata indicated that either a four- or a five-dimension 
represen^'atioV would be appropriate. The factors in the four-diiiieijsion 
solution were labeled by the anf hflr » n< ^ 

^ I Motion-Statics 

II Vectors ^ 

III Gravity-Circulai: Motion 

IV Force-Work-Power . ' ' • 
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The five-factor solatiouxontaine'd all the above factors and another ' * 

which was qpt readily interpretable but involved a cluster of concepts 
on kinetic and potential energy. - ' ^ 

Interpretations, 

Jf \ ' ' . 

. The author believes that perceived dif f erences ^in the difficulty 
of physics concepts resemble distances .in Euclidean space. And students 
construe Ishe concepts along two or' more difficulty dimensions^ Also, • 
the perceptual space 'seemed to be relatively stable for different samples 
from the same^ population ♦ , 

^ ' ' ABSTKACTOR'S ANALYSIS t 

The application of mul^tidiinensional scaling techniqaes to describe 
the structure in students* percepti^s of science con6^£^ is an impoiftant ^' 
area of research and should be pursued* But results in this area are 
going to be elusive and costly. This study is only a beginning, with 20 
physics condepts, and' the results can hardly be considered elucidating, 
.The author does need to be commended^ for assessing the degree of general- 
izability, by triple sampling, in-an area for which coriventional , 
probability statistics and error estimates are not available. 

The study is a step along a long road of determining the nature of 
the learner and. the learning process, and instructional strategies which 
maximize student achievement should be based., on current knowledge in ^ 
this area. But at this point in time^we need to channel the majority of ^ 
our resources in^o more evaluative 'research on methods of improving 
achievement ^d attitudes of the science learner, 

I 
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Butzow, John W. , and 'Alan Davis. ']fhe Development^ of a Semantic . ^ 
Differential Test of Teachers* Attitudes Toward Teaching Elementary 
..School Science." Science Education ^ 9(2) :211-22D; 1975. 

Descriptors — *Career Choice, Educational Research, ^Educational 
. Philosophy, Learning Theories, *Student Attitifdes, *Studqnt 
Teachers, Teacher Behavior, *Teacher Education 

^ Expanded Abstract- and Analysis Prepared Especially for I.S.E. by Ronald 
D. Simpson, North Carolina State University. 



Purpose , , - - ' 

- * , 

^This study had two objectives: (1) to develop an instrument for 
measuring teachers' attitu4es toward -teaching an, open-ended type Of' 
science program such as Elementary Science"" Study (ESS), and (2) to 
administer -this instrument to a group jof teachers usiijg the ESS program 
and correlate the results with their actual teaching behavior as viewed' 
and analyzed via video tape, hence buildin^a case, for reliability and 
validity. 



Rationale 
. ^ 

Th^ success of an elementary school science program such as ESS 
depends in large measure on the degree t6 which the teacher is willitig 
to^ follow the philosophy embodied in the curriculum. Investigators iti 
this study sought to develop a measute that ^ would predict the degree 
to which* individual teachers would be '-student centered/' ' Further^ by 
correlating responses- to this attitude instrument with data generated 
by an already existing observation scale^ it was possible to make 
judgjnents on the validity of the new instrument. This, instrument was 
based' on the semantic differential technique and followed earliex 
work by the senior author. 



Research Design and I^rocedur^ - ' - 

In ^he first part of the study, standard procedures described by 
Osgood et gl . (2) were used to develop an attitude instrument called 
the Semantics Differential Test of Teacher Attitudes (SDTTA) . Initially*, 
104 piemen tttry school majors enrolled in. a science methods course 
responded to three concepts relevant to teaching science in the elemen- 
tary school: "For me, doing science is "For me," teaching science 
is For me , science cbncepts ...."^ Using a five-point scale, 
each concept was subjected to 46 adj^ectival pairs. Results were factor 
analyzed using the Varimax procedure. The investigator's found four 
major* factors which they categorized as valuing, enjoying, striving, 
•and difficulty. For the SDTTA they selected the adjective pair under 
each category with the highest loading ("important-trivial" for^valuing, 
"enjoyable-unenjoyabie" for enjoyir^, "powerful-powerless" for striving, 
^d "easy-^dif f icult" for difficulty)* and used these four bipolar 
adjectives to measure feelings toward 21 teacher behaviors associated 
with the ESS program.- * . • 




After the SDTTA was ^veloped, the instrument waa^ administered ^ 
to 29 elementary classroom teachers attending an'iriservice institute 
• for implementation of ESS. The teachers' responded to the instrument , 
after completing formal coiftrse ins Jt ruction but prior to actual class- ^ 
room iciplementation. After classroom work with ESS had progressed / ^ ^ \ 
for severaj months, each teacher was filmed on. videota^eljwhile teaching ^ 
science. The Science Curriculum Assessmer^t System^Teacher (SCAS-T) V 
developed by Matthews and Phillips was used as a scale for judging the 
videotaped teacher behaviors. The teacher behaviors being studied 
were independently rated by three professional science educators - ^ » ' 

trained to use this instrument and were divided into two subgroups on 
the basis of the teacher directed index (TDI)'of the S^AS-T.^ Hen^e, 
two groups emerged: one known as the teacher-directed group (TDG) and 
the other as the student-directed group (SDG). The latter jgroup con- * y 
tained teachers with a lower teacher directed index, j^^^dicative of the 
type of teaching emphasized by the , developers of ESS. 



A Spearman Rank Correlation was conducted to dete'rmine the rela- 
tionship between teacher scores on the SCAS-T iMd SDTTA. Further ^ 
analysis using dii-square, was conducted in ordl^^o determine if any ^ 
items on the SDTTA produced significantly different scores across the * 
two Subgroups.. . « 

Findings ^ ^ * , . 

When scores of the 29 teachers in this study were rank ordered for 
'both the SCAS-T and SDTTA and were correlated, a coefficient of 0.79 
was found (significant beyond the 0.01 level of confidence). '-When * . 
the 21 concepts contained in the SDTTA were comjfared across the two 
subgroups, TDG and. SDG, Chi-square values suggested a significant 
difference (beyond the 0.1 level of confidence) between the groups on 
the following six items j ^ * ^ 

A. For me, allowing children to mess around with wat^r is . . . 

I. For me, keeping live plants' and animals in the classroom fo^ 

use in experiments is . . . ^ ' ' - ^ 

• N. For me, being able to correctly answer student questiohs in 
science is . . . .. 

0. For me, allowing children to work in groups to discuss their 

poin^ of view and fljKiings is ... * * ^ 

Q, Forme, teaching) science is ... 

S. For me, having a strong background in conceptual and factual 
science is . . . 



Interpretations , 

In this study an instrument, the Semantic Differential Test of 
Teacher Attitude^, was developed, administered, and correlated With 
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teacher behaviors and scored by trained observers using anotffer ins^trument 
known as the Science Curriculum Assessment System. The strong positive 
rank order correlation (0.79) between the two measures suggests that: 
teacher attitudes toward a teaching philosophy such as the one embodied 
in ESS can be used to predict the "student , denteredness" of individual 
teach^fs. Also, findings in this study suggest there are some concepts 
associated with teaching a course like ESS which elic/it significantly 
different attitudes depending on where a* student fits" along the con~ 
tinutim of "teacher directedness" versus "student centeredness . " In 
short, this study produced an attitude instrument that appears usefiil 
in predicting the tendency of a teacher to exhrbit student centeredness 
in the elementary school science classroom. 



ABSTRACTOR'S ANALYSIS 
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Ii^conducting research wherfe attitudes are measured by paper and 
pencil instruments, one can always raise the question, "Do responses on ^ 
such instruments' really reflect the true' feelings of people,- and are 
the alleged attitudes really reflected in^their behavior?" The investi- 
, gatdts in this study addressecL themselves to, this question, subsequently 
producing evidence that the mamer in which a teacher expresses attitudes 
toward a philosophy of teacHing indeed^ correlates positively with how 
they actually behave with' students while teaching. A major contribution ' 
of this stjjdy, then, is that an instrument was developed that predicted 
for the 29 teachers in the study /'student centeredness" *as related to 
teaching science at the elementary school level. Furthermore, the 
feelings these teachers possessed toward concepts dealing with-ehildren, 
science^ classroom management, teaching approaches, plants, animals, 
etc, corresponded to their observed behavior via videotape analysis. 

The import of this study and these- findings are significant for 
at li^ast two reasons. First, an attempt was made to study attitudes 
and behaviors beyond a paper and pencil approach. In this regard, I 
believe this stu^y serves as a potential model for other studies. 
Secondly, this study illuminates further the notion that the success • 
of a given science curriculum may impinge at least .in part on the 
philosophical and attitudinal orientation of the ^acher. If a curric^ 
ulum is designed for maximum student involvement Sut. the teacher does 
not parceive this teaching style as "good,^' "important," or "powerful," 
then an incompatability results that may negate many of the strong 
features of both the ptogram and the teacher. Many excellent science 
programs 'have been developed over the past two decades. In many 
instances these programs reflected def ini^^assumptions ^d attitudes 
on the part of the devel.opers. llany programs destined for success 
have failed because educators who^ adopted Chem did not possess attitudes 
congruent wi^ the* prog-ram. 

- This study can serve as a springboard for further research in ^ 
several c^rcctions. The 'mo^ obvious direction, perhaps, is that of 
preservice and inservic^ preparation to teach elementary school science. 
Conant (1) found that elementary school teacjiers in Portland, Oregoi), 
taught science on the average of no more than two to three minutes 
per day. , If this 1^ indicative of^a nationw^e sit'uation, pne can 
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one can conclude simply that elementary/sfehool teichers prefer not to 
spend their time teaching science. As/l look back over the SDTTA 
Instrument developed for this study, I' can see many attitudes commonly 
found in ojar society (and in pur classrooms) that are not only incon- 
gruent vd.th the spirit, of science but serve as serious barriers to the 
Implementation of programs like ESS. The attitude of teachers toward 
science, children and teaching appears to be a powerful factor in how 
teaching behaviors are ultimately expressed. By dealing with these 
attitudes, science educators involved in teacher preparation and in- 
service programs will. surely become^ more effective in bringing about 
.change in Che quantity and quality of elementary school science 
programs. , > 

I found this study clearly written and easy to follow. The ^ 
research design and statistical procedures appeared appropriate and 
were adequately commLHiicated. 'The method used to develop the SDTTA wai 
sound and indicated a thorough understanding of the semantic differen- 
tial technique by the investigators. Perhaps more could have been said 
abeut the nature of the 29 elementary classroom teachers in this 3t^udy 
and about the SCAS-T instrument developed by Matthews and Phillips. 
In working with a select group of subjects that may be more homogeneous 
than the average of the population, it is always difficult to arbitrarily 
group persons as '*high" or '*low'* on a scale because of the potentially 
skewed nature of the group. Additional normative data on both the SDTTA 
and SCAS-T will be useful. This study provides an important link in 
current attitude reseaiw:h. • These results suggest that attitude and 
teaching behavior are correlated and that- ^ instrument measuring the 
forxoer may be used to predict the latter. Further studies designed to 
consider cause and effect relationsljips appear in order, y 

t 
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i 

Purposd ' y ^ 

The major pi|tpose of this investigation was to study changes in 
attitudes and classroom behaviors of teachers participating in the 
Cooperative ^College-School Science Prbgram conducted at the University 
of Connecticut. . Two specific questions were identified: 

1. Did the Experimental Group differ from the Control Group 
in change of behavior from pretest to posttest? 

2. Did the Experimental Group differ from the Conti;ol Group 

in change of attitude frdm pretest to posttest? • ^ 

Although not specifically stated, another research question was: * 

"> 

3. VHiat vaxiablej|, are related to changes in teacher behavior? , 
^tionale 

The authors point to *the> large amounts of money spept by the 
National Science Foundation in support of the development of new science 
curriculum projects. They state that even though it is aefeumed that , 
teacher Acceptance determines curriculum success, there has been little 
independent evaluation of the effects of the n^w curricula on the , 
attitudes and behaviors of the teachers using them. 

This investigation was designed to study attitudes and behaviors 
of teachers who were using new elementary, science curricula. Further, 
it is stated that the project was conducted, "In order to initiate and 
, Implement the new inquiry-oriented elementary school science ^programs 
<tn Connecticut and to demonstrate the effectiveness of these programs 
in selected c]#^^opms, ^" 



Research Design ,and Procedure 

The research Resign used was a pretest-posttest^ control , group 
design* There were 68 subjects in the experimental group and 14 in 
the control group. The treatment for the experimental group was 
participation in the Cooperative College-School Science Program . The 
control group .subjects did not participate in the Program but were 
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teaching inquiry-oriented science programs. Subjects were not randomly 
i^signed to groups. > < 

Pretests were administered in the spting of 1970 and pbsttesting 
was done in the spring of 1971. Two instruments were employed: The 
Pempek Teacher Behavior Checklist (teacher classroom behavior as viewed 
by students) and the Pempek Teacher Attitude Scale {measure of teacher 
attitudes toward science, science teaching, and' scientists) . , 

The attitude tests were completed by the teachers during pretest 
and posttest sessions. Ratings on teacher behaviors were completed by 
students of the individual teachers. An average of 30 students rated 
each teacher on both "pre" and "ppst" measures^ 

Th^ experimental group attended four introductory sessions in the 
Spring of 1970, a two-week workshop in August, and nine follow-up^ 
sessions during the ensuing year. The experiment aj^ treatment involved 
study of and actual experience with three major science programs: 
Science — A Process Approach (S — APA) , Science Curriculum improvement 
Study (SCIS), and Elementary Science Study (ESS). ^ 

The assumption was made that the Pempek tests did not necessarily 
yield interval data. Thus, data were analyzed by use of non~ 
parametric statistics: data^m changes in behaviors were examined by 
the Mann-Whitney UJest; a ttitudinal, change data were subjected to the 
Wilcoxon Sign Rank* Test and the Spearman Rank Order Coefficient of 
Correlation; and the Kruskal-Wallis .Analysis of Variance Test was used 
to determine the contribution .to the variance by several different 
variables. • ' 



Findings 

The following findings are based on the authors,* siimmary of data, 
analysis ✓ 

1. Although the behavior of b.oth the experimeilPtal and ,conferpl. 
group changed, the differeti'ce between the two groilps was 
not significant at the 0.05^ level. 

' • * * 

2. The experimental group exhibited a statistically signifi- 
cant positive ^change in attitude from prfetest'to posttest 
at the 0.0^ level. • 

3. The control group did' not show a statistically significant 
change in attitude . . - ' 

4. The teachers who had taken the ^ewedt 'credit hours in 
science courses showed the greatest change in* attitudes^ 
Teachers who came into the program^ with strong science 
ba'cJcgrounds' showed the least change in attitude. 

5. The attitudes of those teachers who had not taken graduate 
wojrk in science changed more in terms of the objectives of 
the program than the attitudes of those teachers with 
graduate course Work in science. 
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6. The teachers'who taught in seJ f-coatalned classrook 
even though they taught feywer hours "pe^^..Week with icieftce 
ivro^fect^ ^terial?,, had the.most change in ^ttltudei. 
-Those' teaching -in departmentalized systems changed jleast. 

7. Ch^^^ in attitude as measured by the Pempek Teachet # 
Attitude Scale in this study was found not to be statis- 
ticall5» significant as related to the following factors; 

a. grade level taught; 

b. type of school district; 

c. science project selected; 

d. years of teaching experience. ^ 



Interpretations - ^ 

On* the basis of findings 4, 5, and 6, above, the authors' conclude , 
that: ,1 " 

# ■ 

The teachers in self contained classes were the ones, 
who had weaker backgrounds in science and who taUght scieiace 
only 0-3 hours per week. They were the teachers who at the 
beginning of the project were afraid to teach science and 
felt Inadequate in^science. Their attitudes changed most. 
However, those-^ teachers in departmentalized upper grades had 
many courses in science ^and taught science many hours per ^ ^ 

week. They had definite attitudes established before parti- 
cipating ixk this project and they therefcyjp exhibited the 
least amount oi change in attituae. 

The authors also concluded that the project was effective, in meeting 
thejjbjective of '^^'introducing and implementing 'the use o£ the new science 
programs in Conri^ticut." They feel that the pi;:oject not only "improved 
science teaching and attitudes toward science, but that it also gave ' 
teachers a new perspective in which to view thepiselves, their'"teadi4.ng, ^ 
and their interaction with students. • * 



' . ABSTRACTORS ANALYSIS ^ ' 

In general, this investigation fits into the larger gtbup of .studies 
on teacher characteristics which has received a great deal of attmtlQn 
over the past 15 years or-^o. Classroom. interaction, teacher attitudes, ^ 
etc., became primary resea|:ch targets as* the nation focused on improve- 
ment of teaching in the schools, Of course, partially as a/result of 
the 1957 launching of Sputnik I, the science programs themselves "also ^ 
became targets of research and development. fh\is, this study -which 
investigated relationships between ^f^acher characteristics (attitudes 
and behaviors) and experiences with new science programs seems a logical 
outgrowth oi the -times. 
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In this report', however, the authcyfi do slot state clearly what 
experietlces the\teachers' h^ji with^he q^w silence programs What was 

\'the experimental, -treatment tiut^g the' introdu^tcJry sessions, the two- 
/week' workshop, afid ♦rtie follow-ii}) sessions, for example? How might 
this treatment have affected th^ ^teachers? Sinpe the project involved 
three diffAent p'rograms (S~APA,^.SCIS,-and ESS), is it possible that 

, one program might have affected attitudes and behaviors differently 
than another? CerDainly there, are different phAosophies which under- 
pin'Hi — APA'aad/ESS, for example; And finally, /which of the three 
projects were taught, by -the teachers of tfhe experipaental and control 
grqups during ^he. ^hool y^ar? 




The basic research design (pre ta^BHpttest conl:rol gro^^p;^^ used 
in this study' is sound. J3ec4us(?'.it is not stated' differently , ha|Ke?</er,' 
^'t mu&t be assumed that^he- teachei^s t>fere*hot randomly sheeted rSp* 
raadpmly. 'assigned to ^oups. This, factor is of special concern when 
one notes that there were great differences in the fHinil?6rs of subjects 

; In each group .(68 experimental^ 14 control) and t^at very little is ' 
known about the experiences of either groyp excepA that the control 

. gf o^p teachers "...were not attehding tire Kofksho^^but. . .were teaching 
oawot the inquiry-oriented programs for. the first time...." /But* while 
randomization 4s ideal, behavioral researchers often find themselves 
in situations j|j|^r^u^t, is not possible. The^cjiature of this study, 
suggests that was<thp case here. The authdrs 'are commen4ed on t^eir ^ , 
dttempt through- the use of the Median test to show that ^the experi- 
^ntaX and control groups Were drawn- from the same population. 

It would have been helpful if the authors 'h'ad given more 
infor™^ otw the behavior arf? attitude instruments and the r^'ature 
of tij^^ata collected:- ^There,.is no indication of the Hypes of behaviors 
or iH^tudes eaMpinefl nor £s. there information, on the validity *or reli- 
^ilftjrof th^Bnstruments themselves.. The lack of such information ' 
IJlaces the, validity, of th^ total study in question. T^eltetudy doe^ 
refierence^he beh^^^or ani attitude instruments to the doctoral 'dis- 
sertation of one of the autliors-. However, since the <lissertation is 
n^t^eddily .available, the reader ^s left with several q^uestions 
"""~t ipstrumentatipn. Given the nature of the data assumed to have 
.collected, the uer^^^ non-parametric statistics appears to have 
a wise choice. • ' ' 

The jfrbblfem is 'not S'tated as succinctly and directly ^as it might 
. be and the findings reported in th^f^ study are not entirely consistent 
with- the research questions posed. ^One of the research questions, for 
example, aske^; "DfQ the Experimental Group differ from the Contrpl 
Grdup In change of attitude from pretest to posttest?" However, only 
the anal);;ses. of within group X^i|)erimental and control^ differences 
-dre reportecf^' tha dlYferences^inAj^fetween group performance on* pretest^ 
and posttes^ are not reported* me authors aiso refer, to null hypo- / 
theses which are accepted or rejedted but there are no null hypotheses 
stated in th^ report, -ijt is' the abstractor's assumnpion that tbis report 
is derived *irom a tnuxih^l^r^er work, possibly a dis.6€rtation, and 'that^ 
some ofii the shortcoming^^^eji^^tflf led abpve ^simpiy emphasi^ the' difficulty 
of reducitig at lengthy repe^t^inro a mttch.sraall^ siife* suitable for ^ 
journal public^ation. * , * ' • . ' 




As a final comment on the Written report itself, it. is the ' * ai^ 
abstractor's opinion that a! better choice of caption (title) could have 
been made for Table- 1»/ Generally, a caption should -reveal something 
about ^ the content . (kind or nature of data) in the table— not sifiiply the 
fname of the statistic ^usei to analyze the 4a'ta (Kruskal^Wallis Aijalysis 
.of Variance in' this case). . , ' 

Studies ^l^.ke .U^s on€y,Jand others on teacher ^ttitud^s ^ and b^hayior-s"^ 
proA^ide much insigWpinto what teachers Xt\ink and Kow teachers ac't/ 
Great amounts of cj^ta have 'been accumulated. It would seem, Vibwever, - 
that the press for performance-basad certification, accountability, arid 

'the like, will demand that future srilcj^es on teacher cl^racteris^Ics ^ ' 
Be'.directed toward the relationshi'ps^between those char^cxefiSlsi^s and* 

- t>upil stfcfcess . To continue to accumulate data on teacher pharact£*r- 
istics without the link with pupil success will prove to be of limited 
value! ^ , - ' ' ^ 
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Purpose 



During the late J960|s and eatly 1970's, thje Ne<.WSc. State 
Department of\Education revised the Regent's program ^n earth science. 
This study sought to doc^ent changes in teacher classroom behavior 
resulting from the Implementation of the revised syllabus during a 
^o-Y^v -time period when<s*it first be caiae, available on an optional basis 
in lf70-71 and became mandatory in 1971-72. - ' 



Rationale ' ' , ' • . . 

. r • ' ' ' '3 

* ^ — * . " 'J^ 

IkFatt^pt Is made by the author to relate this study to Others 

conepmed with the clrfS^sroom behavior, qf teachers using "new" science 
Curricula. . " | , ♦ 

' •■ • ' ' • ^ 

> - %• " < 

I^sea,rch'Desfffli ^d Procedure 

Ten te^ch^r-volunteers f rom each of the followii^g, groups were 
selected for study; (A) t*chers wljb elected to ,contin<ie teaching the 
traditional "syllabus during the* last^ear'it was offered (1970-71), 
(B) teacliers who electfd to' iegin' teaching the revised syllabus during 
the first year it was g^rally available <1970-71), (C) te^cheraf^ho 
had p*atticipated in revising the earth science syllabus,, and who were 
continuing to teach it for the secend Or more years. By the end of the ^ 
study r^'^ttritioinr had reduced the number^of teaches to about eight per 
group. More specific figures were not ^iven. 

^equenc^s'of videotapes of their classrodfc behavior were collected 
by alrj^achers in Fall, 1970', Spring, 19^1, and €pring, 1972, following 
dire^flons provided tham by the- author. An additional sequence '6f trapes ' 
was recorded by teachers ^Ti Group A in Fall, 3^71. Each' sequence t:on*' 
sis ted of five* consecutive days of teaching. Five4 trained analyats 6ach> 
categorize^ one day's behaviprs for each teacher for each of the record- 
.ipg periods. Interobserver reliabilities' were in exc^ess Of .70 ori 
Scott's scale. Data cpnsisted of thfe fraction of the week a teacher 
devotdd to^ctiv.ities such as those listed below: *^ 



TABLE 



SELECTED CATEGORIES OF THE TAPE 
ANALYSES IMSTJIUMENT 



Item # De^riptor.^ 



2 All labo^^tQgr related activity ^ ' 

4 Small group laboratory aptivity ( 

^ . - ^ / N r . ^ . 

7' All lecture-discussion* activity 

it 

8 All higher level dispcssfon in large' group format 

- 15 All knowledge and translation in l^rge group ^fprmajt 

X8 Discussion of laboratory ^pfocfedures^^ in large group 

20 All student verbal .behavior in large group format . ' 

25 teacher* verbal tehavior in large group format » 
' ^ . ■ — 

A General Index Score waa also obtained f^om a weighted coi^ibiriatiori of 
ltema2, 8, an^ 20 versiear-7, 15^, .^S 25. The complete listing of cate- 
gor*es is not^ incl^ided in the reprfrVj nor is the pr6ced6re used to 
validate the lidt of categories. 

^ ' ♦ / 

Differences in teaching behavior were looked for, among three groups 
based upon the Fall, 1971, Aata. Longitudinal^llif ferences within Group A 
.were also examined *t)ver the two^yeW period of the study. ^ 

. ^ ' ^ ^ ^ , ^'^ 
Findings . 

The following differences between groups were found to be significant 
ae the .05 level (using the F tatio). Both groups of teachers using the 
revised- syllabus in Fall 1970 (Groups B and C) used laboratory related 
activities 80 percent of the time and lecture discussion about 20 percent, 
whereas the group using tlie traditional syllab'us^dfeoup A) used labora- 
toxy related activities 30 i^ei>cent of tfie tii^e and lecture-discussion, ^ 
70 percent. The teacher dominated during periods^ of large group instruc- 
tion iiv all groups (80 to 85 percent) . * , 

Differences in^teacher behavior were looked for blileen the Fali, 
1970, data for group A and th^ Fall, 1971, data for the samc-grbup^ They 
were teaching the traditional syllabus in 1970 and changed to the 
revised' syllabus the following year. T-values were determined for each 
of the teaching behaviors, as well as the General Index Score. The 
General Index Score indicated that teachers employed significantly more 
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of, the advocated instructional behaviors aftet theyl .adopted the new ' 
dyllabus. Inspection of specif ic^behaviors indicated in most cases a 7^ 
doubling of the time > devoted to the - desirai>Jrfe behaviors and a fine-third 
reduction in time devot^ to" lecture-discu/sion* The fraction of time ^ 
devoted to nigher level discussion tripled. 

'When a simila'r analysis was performed on the Spring, 1971, and Spring, 
1972, datA, however, no ^differences were observed. - , * 

Inj^erpretations ^ ' • 

The differences observed between those teachers usiag the 
traditional syllabus and^ those following the ^revised syllabus only* 
suggest a 'modifigati^ of teacher behavior as result of phe adoption 
of.a curriculum^^^^Tltematiyp explanation? are available. When this 
inroimation is^^s^mbined with the longitudinal study, however, it seems ' 
quite convincing that a change of teaching behavior occurred among ^ ^ 
those teachers who began t^ching the revised 'syllabus in Fall,-L^71. - 
That they seemed to "revert \to previous teachifig practice in the ^ 
Spring of 1972 can be explained by one or ail of the following: (1)^ 
the nature of *the revised syilaDXs .which is deficfient in laboratory 
exper^iences at that tide of the year, (2) a possible"^Teversion to more 
"efficient" means of^ covering material j^hen teachers; became concerned 
about beifig behind the pace of 'the syllabus as spring approached, ^and. 
(3) the involvenfcnt of some t^^hers in preparing their students for 
the Regents examination. ^ . 

Whatever th^ cause for the apparent discrepancy noted above, it 
does point up a problem for educational researchers that is often 
ignored^ Teacher . behavior is highly unstable. Interaction analysis 
techniques, then, to be ad^uate in describing teacher behavior must 
be applied over long time frames, perhaps as long as a year or more. 



ABSTRACTOR'S ANALYSIS • - ' • 

^ In Critiquing this study, one could ^ake the author to task for 
failing to randomly select teachers, for small samples, and perhaps for 
other points of design and analysis. However, such criticism would be 
superficial ancf miss the implications of this study for- res^earchr 
design in educatiap^^ Science educators seem to have gotten *'hung up** 
on sophisticated desfgn and analysis procedures developed-^ th«i con- 
text of the physical and agricultural sciences., attempting to apply'^ 
them in a field of stud^, education, which is tofally Unlike ^tho^$e^ for 
which the techniques were -developed. And, not surprisingly, > we fend up 
with no results or mixed results. Creative effort* must be (firected ^ 
to developing designs fitted* to the proDlems-of conducting ii;i-school 
research with very complicated subjects, including teachers and ^ 
students. This study makes* a pjositive contribution in this regard. 
It used a sensible design, operable within the confines of the school^ 
situation and, as a result, it has obtained logical and sensible 
results; results that ai^e interpr^table and consistent with those of 
the few other rese^rc*hers seeking to describe our schools and what 



goes Qp in them, , a necess^-.f irst ' step in generating theories that will 
Eventually enable us to do theoty-giiided research. ^ . ' ' 



Unfor'timately, hcJwever, there are three* ma jor^deficiencies that 
reduce the significance of this study anfl the results pbtained^ Firsji 
is the failure tor report results' from all of the teacher behavior cate- 
gories included on the tWpe analysis instrument. It would appear that 
• Sthare were a total of 25 or more such categories, yet results ^fe stated 
for only eight. Were the results from all of th^pthers non-significant, 
or perhaps significant but in the "wrong" direction? ' If ^o, and if all' 
categories were closely relatejj to the nature of the r^evised syllabus, 
t^fien the author^ s conclusion t^at teachers did indeed chmge their . 
behavior is ove^gtated. Changes in only s|.x\out of- the 25 or, so -cate- 
gories are hardly convincing of a significant change in. teacher behavior 

The second deficiency is a failure to report^ FalL. 1970 — ^Spring, 
1971 longitudinal analysis for grqyps B-and C. ' Suth an analysis could 
add light, to the interpretations ' of the discrepancy in the .S^pjring, 1971 
— Spring, 1972 comparii ons for group A. If there were a significant 
regression to "traditional" behaviors on the part* of these two^ groups, - 
then that would add e*/ideSce as to the the^ effect of curriculum ' * ' 
tiiarac^ristics -cfn teacher behavior and, depending upon the potential ' ^ 
extent of such differences , allow sorne jifdgemenf on the relative * 
importance of the other two potential reaspns for the^ Spring "regression 
effect"* Scveta-l other conaarisons could also be suggested, each wl^th 
the potential of adding adAtional light to fhe interpretatfons made. , 
Since these data were collected and presumably aual'yzed, one wonders 
why they-.yere not reported. . ' 

The final major deficiency is a failure to relate the results d£ - 
this imvestigati<5ti to others that have been conducted on teacher / ' 
behavior in the context of new curriculijun implementation. ^ / 
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, Campbell, -James Reed. "Cognitive and Affective Process Development and 

Its Relation to a Teacher's Interaction Ratio.". JouFryal of Research 
in-.Sclcnce Teaching , 8(4) :317-324 , 1971.^ • - 
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Expanded Abstract and Analysis Prepared Especially for I.S.E^ by Thomas 
P. .Evans, OiS^gon State Un/versitV* ' - ^ 4 

' • - V • ■ * ■ ■ ■ 

Purpose . ^ . 

The purpose of this study was tp investigate the relationship 
between a Ifeacher 's^ ravi&ed i/jji ratio and the cognitive and affective 
process development of junior high school low achievers. • 

Rationale 

« The rationale for the study grew out of the researcher's concern 
that previous efforts to determine teacher- effectiveness using such ^ " 
variables as tea^^r- ratings and/or characteristics were largely iinsuc^ 
cessful. Within the past decacle, .however, advances have beQn^%ade in 
the development and use of jsystematic observation qf classroom behavior 
&d the results of teacher education. reseafchMnvolving systematic 
observation have been* reported as being more consistent thfan the earlier 
efforts. Indirect teaching h^ been found to correlate v^ith student* 
achievement and attitude at th-e .junior high level in; three short-term 
investigations by Flander^ (6), Amidon and Elanders (1), and LaShier 
(8). This study examines similar relationsjiips over a longer duration 
of time. ' , ^ 

Assumpt^^ons were not "presented, but two seem inherent in the study. 
The first specifically relates to the use of the Flanders System of 
Ihteraction Analysis , It assumes that teachet verbal behavior is an 
adequate sample of a teacher's total classroom behavior^ The second 
assumption is either that the characteristics of the participating 
teachers and various other variables in the classroom environment are* - 
, similar or that they do not appreciably influence student attitude and 
achievement. 



Research Design and- Procedure 

The research design did not follow" one of the paradigms kugges€ed 
and describeH by Cimpbell a^d Stanley in Gage <7), although it showed 
some similarity to the nonequivalent control group Msign. Pretests 
and posttests were administe'red to naturally assembled classrooms; 
however, comparison was made between* two treatments, iBd random assign- 
nlent vas'not* under the corttrol of the Researcher . The independent 
variable was classroom AehaviQr as meaSIired, by the Flanders System o^ 
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Interaction Analy sis '(FSIA) Snd the dependent; variables were student 
cognitive^ and affective process development. Cognitive development was 
measured by thd STEP, test, and affretive proce|^ development was defined 
as scores on DeProspo's Sca le of Susp ended Judgment. Howaiul an^ Robert^ 
son's Scale of 'Ca use and Effect, and Campbell's Sc ientific Curiosity 
Inventory . The, two scales measuring suspended judgmepX and cause and* * 
effect were modified, combine*, and called the Scale of Scientific - 
Attitudes. 

The verbal classroom behavior of 10 junior high science teachers 
was. taped for 11 to 13 forty-five minute lessons 'over the course of one 
academic year., The> tapes were analyzed with the FSIA, and the data for* 
each teacher were combined into d^'grand matrix, consisting of 360 ' * 
minutes of predominant lecture-discussion activity. A revised i/d ratio 

calc^ulated for each teacher by adding the totals of tallies in 
categories i '(accepts feelj^gs), 2 (praises or encourages), and 3>y 
(accepts or uses student's idea) and dividing by totals in categories 
6 (giving directions) and 7 (criticizing or justifying authority)^ 
The taachers were ranked on the basis of their revised 1/d ratios. 
The tap five' (mean i/d rat^lo of 3.14) were considered as being Indirect, 
i^taid^the lower five (mean i/d ratio of 1.32) were considered as being 
direct in their classroom influence. The \wo greups were then'shown to - 
be, significantly different (at the .01 leveJ^ by analyzing the combined 
matrices of botfi groups with a modified Darwitx Chi Square. 

A series 'o^ t tests was used to analyze\lf f erences betr./een students 
in the two groups' on ^ IQ test and all pretest spores or the criterion 
instruments. §lnce the two group^s weffe essentially equivalent in IQ 
and on their Scale of Scientific Attitudes pretest, the p,osttest scores 
on the scale were subjected to a t test. Group scores on Campbell's 
Sfiientific^ Curiosity Invedtory and STEP test Vere analyzed, using an 
analysis of covariance with IQ and pretest scores serving as •varlates, , 
because significant difference^ wete found between the two groups- of * . 
students on the pretest scores. i^, . . * . 

After the results pf the statistical analyses wete obtained, the 
grand matrices of both groups of teachers were compared. This analysis 
was performed in an attempt to identify elements within the teaching 
methodology whlph were responsible for thte differences found in student 
performance.- ^ 



Findings ^ . 

The findings reported by the investigator were as Allows:* , 

* (1) the Hfean posttest score of students in the indirect group \ 
• - on the scale^of Scientific Attitudes Was. significantly ' 

higher at the- .05 level than the mean posttest score of * 
students in the direct group; 

(2) the adjusted mean difference on the posttest scores of 
• Campbell's Scientific Curiosity Inventory was .significarlt 

at the 0.25 l^vel, with sftidents in the Indltect group 
^be^ng significantly higher than those in the direct groyp^\ 
and 
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(3) the adjusted posttest mean df studedts in the Indirect 
group on the STEP test was significantly higher at the 
.001 level than was the ad^sted ppsttest mean of students^ 
in. the direct group, ^ * 



Interpretations " ' , ■ , 

T^e conclusion was reached that the indirect teaching methbdology 
was more effective than the direct for cognitive and affective pr6cess 
djp^elopment of low achievers at the junior high' school level. Differ- 
ences^in the posttest. means of Scale of Scientific Attit;u de^ wer^* 
attributed to higher cooperation in the ^indirect classes as contrasted 
to hostility, resistance, and a high level of negative fictional feeling 
bn the part of students in the .direct classes. 

* After examining the grand matrices of bpth groups of teachers, it 
was concluded that student growth- in attitude and adiievement- was not 
specifically the result of indire<jjt behavior alone. In fact, the two 
groups of teachers were not substantially' different pi their indirect 
verbal behavior. The percentage column totals for indirect behavior 
(categories 1, 2 and 3) were 11.43 for.the indirect and 11.06 for the 
direct teachers. They differed in their direct classroom behavior 
(categories 6 and 7) wi4:h the direct group exhihititig twice as much 
direction activity .and five times as much criticism >as the indirect 
teachers. .The direct t;e?achers also spent more ''time giving extended 
directions and criticism^ Thus, it was further concluded that the 
critical element responsible for differences in student growth "In * 
cognitive and affective process development was the excessive, or lack 
of excessive, use of negative verbal beha^ors dk tlie part of classroom 
teachers. ^ - \ ' , / \ 
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^ ' . ABSTRACTOR'S ANAL' 

• ' ' • . .> 

I This study represents one of .several in which attempts have been 

made to find relationships between science teacher behavior as measured 
by FSIA and student achievement and/or attitude. At 16ast 12 were 
reviewed b^r Evans in the ]^7'3 Yearbook of the Association for the Educa- 
tion of Teachers in ScieaAe (.3). Althou^ Campbell reported a pcfsitive 
relationship between indirect teachiftg'^lfifethodoXogy aad student p'erfoi:- 
mance, .his results have not been consistently supported by ot^^r. 
• 4 investigators. Unfortunately, the r'esults of teadier effectiveness 
' , research in sci^Jce education remain contradictory, and incoodistent even 
tllpugh category systems have been used to quantify classroom, dialogue (3). 

• ' Overall the report was' well-written. The probl^^m, methodology, 

' ^ analyses, findings, and conclusions were cledr and to the point. Unlike 

many» reports involving the FSIA, the category system was only briefly 
(fescribed, Hut th^ report spelled out the method for calculating the ' 
revised i/d ratio in detail. .This latter procedure 1^ particularly 
Important, because the revised i/d ratio can be calculated in one of two 
ways depending upon which observer^ manual the researcher was following. 
In addlton to the me^thod described in the report, the "revised i/d ratio 
^ . can be obtained by adding the total of tallies ln>^egories i, 2', and 3, 
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and divlding.by this totals in f ategories 1, 2, 3, 6, and 7 (2)*. Simply 
presented revised i/d ratios without the method for calculation has 
little meaning and cannot be properly compared with findings ojE other 
investigations involving the ratio. 

^ .A further merit of the ^research was the, length of the observation 

sessions. CampbelL reparted that each taping' session was 45^ minutes 
• In lehgth-r- The entire science lesson was apparently analyzed, although 
the, report does not specifically comment on this point. Regardless, 
^ - a As-minute obseirv^ation is more likely to include teacfier statements at 

, the beginning and end of a iesson. Such statements frequently set the 
* . ^ ^.fmotional climate for the entire lesson and for lessons that follow. A 
45-minute, observation period provides a more accurate description of ^ * 
classroom dialogue, and it represents an* imptovement ove.r the usuST 10- 
to 20-minute sample taken during the middle" of a l,esson that seems to, 
.^be the standard for mo^t researchers w'hd use the FSIA. ' 

The.report would have been ii^joved and. Easier to analyze if it, r 
had contained more information aboujttivr^aeher, student,, observation, 
and -ins taructional variables. How were the, teachers selected, and what 
were their gefieral characteristics? . What instructional materials were 
used in the classrooms? What' topics were covered in the Science classes? 
What were the -sizes ^and locations of the schools? Were the observations 
made. at random throughout the school year and day?, Did the teachers 
know in advance when the, observations were to be piade? What were the ' 
student characteristics besides IQ and pretest scores? A report should 
include this type of information or a statement that tH^variables 
were- examined^ and found to be similar for both groups, ^uch information • 
18 especially necessary wh^ randomization has .not been under the control 
of, the researcher. Lack of the information mak6s it impossible to 
. determine whether or not the variables offer plausibly hypotheses for 
- . explaining differences in student performance* that rival the stated 
Effects of the indirect teaching methodology. 

Additional" information 4;hat would have been useful in the analysis 
of the report imcludes the revised 1/d ratios of the individual teachers, 
combined matrices of each group, rationale for using the ratios while ' 
omitting other available measures of indirect and direct classroom beha- ' 
/ ylor, and a coefficient of Mnter-observ^r agreement. The mean revised 

, ^ . i/d ratios were presented and differences between the' groups had been - 
determiMd by analyzing the combined matrices of both groups. As a 
result^K cannot be certain of the exact differences between the groups 
of tej^B|s. For example, they could have differed significantly as 'a 
result^^he,tallie||in the lecturing, silence and confusion, asking 
quest:13Wr or. studraJFtalk categories. Ano'ther possibility was that one 
or two very indire^ and one or two. very direct teachers were involved 
in the study^jpj^extremes could cause the gf oup -mean^ to be si^iftcantly 
<4f f erent , ^trtT'^et , a majority of .the teadhers might still have been 
^ ^quite simi^lar 4n their -^ndLrect or direct teaching methodologies. Inclu- 
^ sion of the individual revised i/d ratios and the combined matrices of 

- each group would eliminate the question of whether or. not the individuals 
. and groups of teachers were different in their indirect and direct ' - 
classroom influence. * 

Hie r^ason f or requesting a rationale foi^ using only the revise! 1/d ^ 
• " ° analysis is that it: does not itTclude lectdring and questSning 
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behaviors. The ratio is associated with control and motivation rather - 
than' with the presentation of subject matter. One might suspect that 
the revised i/d ratio would be related to attitude • but achievement 
might be mof'e closely related to lec-turing and asking questions. The 
fact that some relationship appears logical does not mean that it 
actually %xists, but a rationale for not examining the relationship 
seems reasonable, especially when the data were already available. 

The establishment of inter-observer agreement is a crucial task, 
and one that should be accomplished before, and checked peViodically 
during, all research involving systematic . observation of classroom 
behaviour. A coefficient of inter-observer agreement of .9 and above 
is not unusual after a fairly short training period in :tiie use of fSIA* 
• It provides an indication of the objectivity of the observatiofJal 
technique and a measure of how reliable the obs-erver has been in encod- 
ings behaviors. Inter-observer agreement and the method of determining 
a coefficient were not mentioned in the report. No doubt this 'was an 
- oversight, or perhaps it was omitted by the journal- editor. Most 
researchers using systematic observation 'of classroom behavior are aware 
of its importance. ' Measures of the independent variables with the 
are used if a coefficient is not established. 

The conclusion regarding the Effectiveness of indirect teaching 
methodology and student attitude was logical based solely on: an analysis 
of posttest'or adjusted mean posttest scores, but examination of both 
pretests and posttests provides a different, picture. Significant 
differences between the groups were- the results of losses, not gains, on 
the Criterion instruments. The indirect group mean increased slightly 
from 5,01 to 5.10 between the pretest and pgsttest on the attitude scale 
but a majority of the difference resulted from a decrease in tl^e direct 
' group mean from 5.01 to 4.83. I^e indirect group mean went from 26.^3 
to 26,34 on the curiosity inventory, while the direct group mean went 
from 27.25 to 22.97. Both groups of students decreased in scientific 
curiosity with the indirect group decreasing significantly less than 
the direct :gr6up. From these data it is temt)ting to conclude that no 
science teaching would be more effective for affective process develop- 
ment than was either an indirect or direct teaching methodology; ' 
unfortunately, data from a control .grqup who did not receive science - 
instruction are nt)t available. # " . 

Significant differences resulting /rom fosses it! positive attitude 
by treatment and control groups Jfc with Jne control group losing signifi^ 
'cantly more than' the experimental group*, are fairly common. They point 
out the need for additional research on attitudes an4 the relationship 
between st:udent attitude and instruction. Such findings question the 
use of a posttest only control-group design in st.udent attitude research 
when the treatment is simp^v an alternate instructional strategy, and 
they indicate' the need for cofiipari^on data on students who have not 
recei^^ed instf uction in the subject area under consideration (3). 

♦ * 

A critique of any research inyolving'th^ FSIA would be incomplete 
without mentioning a few of the major limitations ^£ the observational 
system. Oho major limitation is th;at the system B based on a question- 
able assumption; i.e., a sample of verbal behavio*is"an adequate sample 
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of a- teacher's total classroom feehavior. It has been shown that a major 
poirtion of a teacher' s» classroom behavior is nonverbal (5). Nonverbal 
behaviors accent, illustrate, coincide with, substitute for, augra^nty^ 
and contradioi verbal behaviors (4) and evidence exists indicating thiat 
they are bej^er communicators of emotion and attitude than verbal J 
behaviors (9, 10). "These findings suggest that nonverbal behaviors are 
too important to be excluded from 'any accurate description of classroom 
behavior. 

.A second limitatiq^ is related to the large number «f ground rules 
used in encoding the observations. Ground rules improve inter-observer 
agreement, but they can provide a distorted description of what actually 
took place in the classroom. A third limitation is that the FSIA does 
not account ior differences or extremes within each category. A 
distinction is not made'between silence and- confusion, and both mild and 
vehement criticism are simply recorded as criticism. The fact that the 
system is not appropriate for certain classroom activities is a fourth 
limitation. Among the activities that must be excluded are student 
laboratory work, small group projects,' individuaLi2^id work, anti teacher^ 
use pf instructional materials and strategies! which do not require ^ 
teacher talk. . .» 

^" - *^ ' . . ' . 
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